00000001:02000400:2.0F:1789181214.655040:0:2960:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg432-server.virtnet: executing set_hostid 00000001:02000400:3.0F:1789181236.847254:0:3181:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg432-server.virtnet: executing load_modules_local 00000001:01000000:3.0:1789181239.116788:0:3224:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 503 MB/s 00000001:01000000:3.0:1789181239.367744:0:3224:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 593 MB/s 00000001:01000000:3.0:1789181239.617549:0:3224:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 3523 MB/s 00000020:02000000:0.0F:1789181240.828251:0:3272:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_39_g3d58bdf 00000400:02000000:1.0F:1789181242.188604:0:3287:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.204.132@tcp [8/256/0/180] 00008000:02000000:1.0:1789181246.490685:0:3437:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0:1789181296.765001:0:5238:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg432-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1789181309.409172:0:5823:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789181309.409178:0:5823:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1789181309.409836:0:5823:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000007c660436 00000080:02000400:1.0:1789181309.409850:0:5823:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:1.0:1789181309.416818:0:5823:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:1.0:1789181309.416836:0:5823:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1789181309.416876:0:5823:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000009c6ad140) 00000020:00000080:1.0:1789181309.416899:0:5823:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1789181309.437531:0:5823:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1789181309.438149:0:5823:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1789181309.469694:0:5823:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1789181309.469871:0:5823:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1789181309.469893:0:5823:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1789181309.469947:0:5823:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1789181309.469972:0:5823:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1789181309.470467:0:5823:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1789181309.470474:0:5823:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789181309.470487:0:5823:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8f4f7840b2e40e21 00000020:01000004:3.0:1789181309.470494:0:5823:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1789181309.470498:0:5823:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1789181309.470502:0:5823:0:(tgt_mount.c:101:server_register_mount()) register mount 000000007c660436 from MGS 00000020:01000004:3.0:1789181309.470506:0:5823:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1789181309.470531:0:5823:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000fe461654) 00000020:00000080:3.0:1789181309.470540:0:5823:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1789181309.470867:0:5823:0:(tgt_mount.c:153:server_get_mount()) get mount 000000007c660436 from MGS, refs=2 00080000:01000000:3.0:1789181309.470873:0:5823:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789181309.470878:0:5823:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8f4f7840b2e40e2f 00000100:00100000:3.0:1789181309.470971:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1789181309.471456:0:5823:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1789181309.471463:0:5823:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1789181309.472129:0:5823:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1789181309.472137:0:5823:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1789181309.473959:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789181309.474120:0:5823:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1789181309.474126:0:5823:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1789181309.475045:0:5823:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1789181309.475059:0:5823:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1789181309.475955:0:5823:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1789181309.475965:0:5823:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1789181309.477546:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181309.477551:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181309.477553:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181309.478032:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181309.478034:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181309.478035:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181309.478661:0:5823:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1789181309.480541:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:1.0:1789181309.732103:0:5823:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2343 MB/s 00000001:01000000:0.0:1789181309.981530:0:5823:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2343 MB/s 00000001:01000000:2.0:1789181310.232310:0:5823:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 375 MB/s 00000001:01000000:2.0:1789181310.483509:0:5823:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 577 MB/s 00080000:10000000:3.0:1789181310.502542:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:2.0:1789181310.529493:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1789181310.562280:0:5823:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1789181310.562323:0:5823:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1789181310.562326:0:5823:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1789181310.565757:0:5833:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1789181310.565908:0:5823:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1789181310.565959:0:5823:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:2.0:1789181310.566189:0:5823:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1789181310.566217:0:5823:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1789181310.568737:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789181310.568909:0:5823:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1789181310.568915:0:5823:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1789181310.575401:0:5823:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1789181310.575430:0:5823:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1789181310.590364:0:5823:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1789181310.590377:0:5823:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1789181310.594454:0:5823:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1789181310.594478:0:5823:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.132@tcp' 00000020:01000004:2.0:1789181310.594480:0:5823:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1789181310.594529:0:5823:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.132@tcp (typ=mgc) 00000020:00000080:2.0:1789181310.594567:0:5823:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.132@tcp (00000000e2694ca3) 00000020:00000080:2.0:1789181310.594583:0:5823:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1789181310.594719:0:5823:0:(ldlm_lib.c:102:import_set_conn()) imp 000000003d0a28ab@MGC192.168.204.132@tcp: add connection 192.168.204.132@tcp at head 00010000:00010000:2.0:1789181310.594867:0:5823:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.132@tcp-0 is initialized 00000040:01000000:2.0:1789181310.594872:0:5823:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.132@tcp ctxt 1 is initialized 00000100:00080000:1.0:1789181310.595241:0:5838:0:(pinger.c:468:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1789181310.617567:0:5840:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1789181310.617747:0:5823:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.132@tcp (uuid 880710ad-110c-42a4-a174-ab1b99a7ebeb) 00000020:00000080:2.0:1789181310.617774:0:5823:0:(genops.c:1384:class_connect()) connect: client 880710ad-110c-42a4-a174-ab1b99a7ebeb, cookie 0x8f4f7840b2e40e3d 00000100:00080000:2.0:1789181310.617786:0:5823:0:(import.c:545:import_select_connection()) MGC192.168.204.132@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789181310.617798:0:5823:0:(import.c:666:import_select_connection()) MGC192.168.204.132@tcp: import 000000003d0a28ab using connection 192.168.204.132@tcp/0@lo 00000100:00100000:2.0:1789181310.617861:0:5823:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000ebfb7d5b x1876092510011520/t0(0) o250->MGC192.168.204.132@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789181310.617894:0:5823:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import 880710ad-110c-42a4-a174-ab1b99a7ebeb->MGS 00000020:01000004:2.0:1789181310.617917:0:5823:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1789181310.617922:0:5823:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1789181310.617944:0:5823:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000f7bd18a3) 00000020:00000080:2.0:1789181310.617956:0:5823:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1789181310.625138:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ebfb7d5b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:880710ad-110c-42a4-a174-ab1b99a7ebeb:3302:1876092510011520:0@lo:250: 00000100:00100000:1.0:1789181310.625237:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181310.627359:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510011520 00000100:00100000:3.0:1789181310.627376:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510011520 00000100:00100000:3.0:1789181310.627419:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789181310.627426:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007f02f758 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3302:x1876092510011520:12345-0@lo:250: 00010000:00080000:3.0:1789181310.627451:0:5835:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 880710ad-110c-42a4-a174-ab1b99a7ebeb@0@lo t0 exp 0000000000000000 cur 202 last 0 00000020:00000080:3.0:1789181310.627480:0:5835:0:(genops.c:1384:class_connect()) connect: client 880710ad-110c-42a4-a174-ab1b99a7ebeb, cookie 0x8f4f7840b2e40e4b 00000100:00080000:3.0:1789181310.627626:0:5835:0:(import.c:65:import_set_state_nolock()) 00000000fee17d1a : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789181310.627735:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007f02f758 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+5:3302:x1876092510011520:12345-0@lo:250: Request processed in 308us (2498us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181310.627742:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789181310.627795:0:3302:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.204.132@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1789181310.627803:0:3302:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.204.132@tcp: connect to target with instance 0 00000100:00080000:3.0:1789181310.627810:0:3302:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.204.132@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1789181310.627815:0:3302:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1789181310.627817:0:3302:0:(import.c:65:import_set_state_nolock()) 000000003d0a28ab MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1789181310.627820:0:3302:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1789181310.627826:0:3302:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1789181310.627831:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ebfb7d5b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:880710ad-110c-42a4-a174-ab1b99a7ebeb:3302:1876092510011520:0@lo:250: 00000100:00100000:1.0:1789181310.660294:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789181310.660899:0:5823:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1789181310.660905:0:5823:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1789181310.665220:0:5823:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1789181310.665238:0:5823:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1789181310.666003:0:5823:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1789181310.666010:0:5823:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1789181310.666761:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789181310.666940:0:5823:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1789181310.666950:0:5823:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1789181310.667872:0:5823:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1789181310.667879:0:5823:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1789181310.766121:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789181310.770976:0:5823:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1789181310.770992:0:5823:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1789181310.772403:0:5823:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1789181310.772412:0:5823:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1789181310.773108:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789181310.773273:0:5823:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789181310.773278:0:5823:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1789181310.773844:0:5823:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789181310.773851:0:5823:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1789181310.775153:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789181310.775321:0:5823:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789181310.775401:0:5823:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1789181310.782927:0:5823:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789181310.782947:0:5823:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1789181310.784008:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789181310.784201:0:5823:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789181310.784207:0:5823:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1789181310.784932:0:5823:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789181310.784940:0:5823:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1789181310.851133:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789181310.851324:0:5823:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1789181310.854754:0:5823:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1789181310.860192:0:5823:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1789181310.860211:0:5823:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1789181310.861362:0:5823:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789181310.861375:0:5823:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1789181310.865152:0:5823:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1789181310.865181:0:5823:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1789181310.865187:0:5823:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.132@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1789181310.865313:0:5823:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.132@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789181310.865378:0:5823:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.132@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1789181310.865383:0:5823:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789181310.865385:0:5823:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789181310.865386:0:5823:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789181310.865387:0:5823:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789181310.865388:0:5823:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789181310.865389:0:5823:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789181310.865390:0:5823:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789181310.865392:0:5823:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789181310.865393:0:5823:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789181310.865395:0:5823:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789181310.865396:0:5823:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789181310.865398:0:5823:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789181310.865400:0:5823:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1789181310.865402:0:5823:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789181310.865403:0:5823:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789181310.865404:0:5823:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789181310.865405:0:5823:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789181310.865406:0:5823:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789181310.865407:0:5823:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789181310.865408:0:5823:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789181310.865414:0:5823:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789181310.865415:0:5823:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789181310.865416:0:5823:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789181310.865416:0:5823:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789181310.865417:0:5823:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789181310.865444:0:5823:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1789181310.865461:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d5c9a438 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:5823:1876092510011648:0@lo:253: 00000100:00100000:2.0:1789181310.865554:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181310.865602:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set 0000000056730ed8 going to sleep for 11 seconds 00000100:00100000:1.0:1789181310.865834:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510011648 00000100:00100000:1.0:1789181310.865842:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510011648 00000100:00100000:1.0:1789181310.865888:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789181310.865896:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f761a1e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+5:5823:x1876092510011648:12345-0@lo:253: 20000000:01000000:1.0:1789181310.865939:0:5837:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789181310.865942:0:5837:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1789181310.866287:0:5858:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1789181310.866371:0:5837:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1789181310.866676:0:5837:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789181310.868053:0:5859:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1789181310.875910:0:5837:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789181310.875920:0:5837:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1789181310.875926:0:5837:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1789181310.875929:0:5837:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1789181310.875944:0:5837:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1789181310.876175:0:5837:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789181310.876478:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1789181310.876491:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789181310.876543:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1789181310.876595:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1789181310.876637:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1789181310.876753:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1789181310.876762:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1789181310.876809:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1789181310.876817:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1789181310.876850:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1789181310.876857:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1789181310.876886:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1789181310.876932:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1789181310.876964:0:5837:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1789181310.876969:0:5837:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1789181310.876984:0:5837:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789181310.877191:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1789181310.877200:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1789181310.877235:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1789181310.877270:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1789181310.877323:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1789181310.877361:0:5837:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1789181310.877433:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1789181310.877442:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1789181310.877485:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1789181310.877523:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1789181310.877557:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1789181310.877568:0:5837:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1789181310.877669:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1789181310.877678:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1789181310.877712:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1789181310.877745:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1789181310.877923:0:5837:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1789181310.877973:0:5837:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1789181310.877980:0:5837:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1789181310.885863:0:5860:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1789181310.886241:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1789181310.886271:0:5837:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.132@tcp for mdt 20000000:01000000:2.0:1789181310.886273:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.132@tcp (null) (null) (null) 00000040:00080000:2.0:1789181310.886313:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1789181310.886322:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1789181310.886408:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1789181310.886554:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.204.132@tcp (null) (null) 00000040:00080000:2.0:1789181310.886612:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1789181310.886625:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1789181310.886675:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1789181310.886715:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1789181310.886785:0:5837:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1789181310.886789:0:5837:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1789181310.886795:0:5837:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1789181310.886801:0:5837:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1789181310.887169:0:5861:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:0.0:1789181310.894393:0:5837:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1789181310.910944:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1789181310.910988:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:0.0:1789181310.911072:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:0.0:1789181310.911089:0:5837:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1789181310.911091:0:5837:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1789181310.911095:0:5837:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1789181310.911106:0:5837:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1789181310.911109:0:5837:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1789181310.911137:0:5837:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1789181310.911139:0:5837:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789181310.914688:0:5862:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:1.0:1789181310.915080:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:1.0:1789181310.915131:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:1.0:1789181310.915209:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 20000000:01000000:1.0:1789181310.915224:0:5837:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1789181310.915226:0:5837:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1789181310.916758:0:5863:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1789181310.917132:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1789181310.917180:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1789181310.917217:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:2.0:1789181310.917239:0:5837:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789181310.917242:0:5837:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:2.0:1789181310.917250:0:5837:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789181310.917271:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000004ae409e4/0x8f4f7840b2e40e52 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181310.917288:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004ae409e4/0x8f4f7840b2e40e52 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181310.917298:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000004ae409e4/0x8f4f7840b2e40e52 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181310.917303:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000004ae409e4/0x8f4f7840b2e40e52 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181310.917309:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000004ae409e4/0x8f4f7840b2e40e52 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181310.917315:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000004ae409e4/0x8f4f7840b2e40e52 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181310.917321:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004ae409e4 already unused, calling callback (00000000f784e0c9) 00010000:00010000:2.0:1789181310.917324:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000004ae409e4/0x8f4f7840b2e40e52 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181310.917381:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000004ae409e4/0x8f4f7840b2e40e52 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181310.917393:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000004ae409e4/0x8f4f7840b2e40e52 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181310.917400:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000004ae409e4/0x8f4f7840b2e40e52 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181310.917416:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004ae409e4/0x8f4f7840b2e40e52 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789181310.917433:0:5837:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1789181311.330467:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f761a1e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+5:5823:x1876092510011648:12345-0@lo:253: Request processed in 464561us (464903us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181311.330492:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789181311.331629:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d5c9a438 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:5823:1876092510011648:0@lo:253: 10000000:01000000:1.0:1789181311.331661:0:5823:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789181311.331800:0:5823:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789181311.331803:0:5823:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789181311.331804:0:5823:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789181311.331805:0:5823:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:1.0:1789181311.331807:0:5823:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789181311.331808:0:5823:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789181311.331809:0:5823:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789181311.331811:0:5823:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789181311.331812:0:5823:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1789181311.331814:0:5823:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789181311.331816:0:5823:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789181311.331837:0:5823:0:(tgt_mount.c:101:server_register_mount()) register mount 000000007c660436 from lustre-MDT0000 10000000:01000000:1.0:1789181311.331863:0:5823:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1789181311.331866:0:5823:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789181311.331871:0:5823:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9dc18851cd40 10000000:01000000:1.0:1789181311.331875:0:5823:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789181311.331884:0:5823:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9dc18851cd40 from 1 10000000:01000000:1.0:1789181311.331888:0:5823:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789181311.331942:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.132@tcp lock: 00000000a69eae34/0x8f4f7840b2e40e59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181311.331953:0:5823:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.132@tcp lock: 00000000a69eae34/0x8f4f7840b2e40e59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181311.331961:0:5823:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.132@tcp lock: 00000000a69eae34/0x8f4f7840b2e40e59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181311.331978:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a7774192 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:5823:1876092510011776:0@lo:101: 00000100:00100000:1.0:1789181311.332102:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181311.332212:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set 000000002d08d203 going to sleep for 11 seconds 00000100:00100000:0.0:1789181311.332404:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510011776 00000100:00100000:0.0:1789181311.332784:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510011776 00000100:00100000:0.0:1789181311.332889:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789181311.332898:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000044f34756 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+5:5823:x1876092510011776:12345-0@lo:101: 00010000:00010000:0.0:1789181311.332910:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181311.332925:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000fceb3e5c/0x8f4f7840b2e40e60 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f4f7840b2e40e59 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181311.332947:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fceb3e5c/0x8f4f7840b2e40e60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f4f7840b2e40e59 expref: 6 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181311.332957:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000fceb3e5c/0x8f4f7840b2e40e60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e40e59 expref: 6 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181311.332964:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000fceb3e5c, rc 0) 00000100:00100000:0.0:1789181311.333020:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000044f34756 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+6:5823:x1876092510011776:12345-0@lo:101: Request processed in 125us (920us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181311.333026:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789181311.333097:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a7774192 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:5823:1876092510011776:0@lo:101: 00010000:00010000:1.0:1789181311.333110:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.132@tcp lock: 00000000a69eae34/0x8f4f7840b2e40e59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e40e60 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181311.333129:0:5823:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.132@tcp lock: 00000000a69eae34/0x8f4f7840b2e40e59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f4f7840b2e40e60 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181311.333190:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a7774192 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:5823:1876092510011904:0@lo:501: 00000100:00100000:1.0:1789181311.333218:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181311.333978:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set 000000002d08d203 going to sleep for 11 seconds 00000100:00100000:3.0:1789181311.334126:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510011904 00000100:00100000:3.0:1789181311.334133:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510011904 00000100:00100000:3.0:1789181311.334173:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789181311.334191:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000083e6dd96 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+6:5823:x1876092510011904:12345-0@lo:501: 00000100:00100000:3.0:1789181311.334503:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000083e6dd96 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+6:5823:x1876092510011904:12345-0@lo:501: Request processed in 323us (1285us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789181311.334511:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789181311.334847:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a7774192 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:5823:1876092510011904:0@lo:501: 10000000:01000000:1.0:1789181311.334878:0:5823:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.132@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789181311.334900:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.132@tcp lock: 00000000a69eae34/0x8f4f7840b2e40e59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e40e60 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181311.334910:0:5823:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.132@tcp lock: 00000000a69eae34/0x8f4f7840b2e40e59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e40e60 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789181311.334919:0:5823:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9dc1add60800 10000000:01000000:1.0:1789181311.334924:0:5823:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789181311.334929:0:5823:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9dc1add60800 10000000:01000000:1.0:1789181311.334931:0:5823:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1789181311.334934:0:5823:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9dc1add60800 from 1 10000000:01000000:1.0:1789181311.334938:0:5823:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1789181311.334963:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.132@tcp lock: 0000000019fcaa8c/0x8f4f7840b2e40e67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181311.334970:0:5823:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.132@tcp lock: 0000000019fcaa8c/0x8f4f7840b2e40e67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181311.334978:0:5823:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.132@tcp lock: 0000000019fcaa8c/0x8f4f7840b2e40e67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181311.335018:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a7774192 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:5823:1876092510012032:0@lo:101: 00000100:00100000:1.0:1789181311.335052:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181311.335074:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set 000000002d08d203 going to sleep for 11 seconds 00000100:00100000:3.0:1789181311.335371:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510012032 00000100:00100000:3.0:1789181311.335377:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510012032 00000100:00100000:3.0:1789181311.335404:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789181311.335411:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ad9956c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+6:5823:x1876092510012032:12345-0@lo:101: 00010000:00010000:3.0:1789181311.336067:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181311.336086:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f5716619/0x8f4f7840b2e40e6e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f4f7840b2e40e67 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181311.336108:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f5716619/0x8f4f7840b2e40e6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f4f7840b2e40e67 expref: 7 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181311.336118:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f5716619/0x8f4f7840b2e40e6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e40e67 expref: 7 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181311.336125:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f5716619, rc 0) 00000100:00100000:1.0:1789181311.336565:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a7774192 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:5823:1876092510012032:0@lo:101: 00010000:00010000:1.0:1789181311.336584:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.132@tcp lock: 0000000019fcaa8c/0x8f4f7840b2e40e67 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e40e6e expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181311.336592:0:5823:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.132@tcp lock: 0000000019fcaa8c/0x8f4f7840b2e40e67 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f4f7840b2e40e6e expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789181311.336606:0:5823:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.132@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1789181311.336619:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.132@tcp lock: 0000000019fcaa8c/0x8f4f7840b2e40e67 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e40e6e expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181311.336626:0:5823:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.132@tcp lock: 0000000019fcaa8c/0x8f4f7840b2e40e67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e40e6e expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789181311.336642:0:5823:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789181311.336647:0:5823:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789181311.336652:0:5823:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9dc1add60800 10000000:01000000:1.0:1789181311.336655:0:5823:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1789181311.336658:0:5823:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1789181311.336660:0:5823:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00000100:00100000:3.0:1789181311.337096:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ad9956c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+7:5823:x1876092510012032:12345-0@lo:101: Request processed in 1684us (2043us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181311.337106:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1789181311.337250:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.132@tcp lock: 0000000017bdd2c1/0x8f4f7840b2e40e75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181311.337259:0:5823:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.132@tcp lock: 0000000017bdd2c1/0x8f4f7840b2e40e75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181311.337282:0:5823:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.132@tcp lock: 0000000017bdd2c1/0x8f4f7840b2e40e75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181311.337298:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a7774192 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:5823:1876092510012160:0@lo:101: 00000100:00100000:1.0:1789181311.337357:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181311.337384:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set 000000002d08d203 going to sleep for 11 seconds 00000100:00100000:0.0:1789181311.338342:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510012160 00000100:00100000:0.0:1789181311.338351:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510012160 00000100:00100000:0.0:1789181311.338400:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789181311.338408:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005020f31b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+7:5823:x1876092510012160:12345-0@lo:101: 00010000:00010000:0.0:1789181311.338420:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181311.338432:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a5942f4c/0x8f4f7840b2e40e7c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f4f7840b2e40e75 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181311.338454:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a5942f4c/0x8f4f7840b2e40e7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f4f7840b2e40e75 expref: 8 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181311.338462:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a5942f4c/0x8f4f7840b2e40e7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e40e75 expref: 8 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181311.338484:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a5942f4c, rc 0) 00000100:00100000:0.0:1789181311.340853:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005020f31b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+8:5823:x1876092510012160:12345-0@lo:101: Request processed in 2435us (3486us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181311.340867:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789181311.347899:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a7774192 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:5823:1876092510012160:0@lo:101: 00010000:00010000:1.0:1789181311.347931:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.132@tcp lock: 0000000017bdd2c1/0x8f4f7840b2e40e75 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e40e7c expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181311.347944:0:5823:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.132@tcp lock: 0000000017bdd2c1/0x8f4f7840b2e40e75 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f4f7840b2e40e7c expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181311.348046:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a7774192 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:5823:1876092510012288:0@lo:501: 00000100:00100000:1.0:1789181311.348124:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181311.348736:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510012288 00000100:00100000:3.0:1789181311.348745:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510012288 00000100:00100000:3.0:1789181311.348796:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789181311.348804:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c5591d01 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+8:5823:x1876092510012288:12345-0@lo:501: 00000100:00100000:3.0:1789181311.349093:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c5591d01 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+9:5823:x1876092510012288:12345-0@lo:501: Request processed in 289us (968us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181311.349101:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789181311.349461:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set 000000002d08d203 going to sleep for 11 seconds 00000100:00100000:1.0:1789181311.349484:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a7774192 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:5823:1876092510012288:0@lo:501: 00000100:00100000:1.0:1789181311.349525:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a7774192 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:5823:1876092510012416:0@lo:503: 00000100:00100000:1.0:1789181311.349582:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181311.349601:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set 000000002d08d203 going to sleep for 11 seconds 00000100:00100000:2.0:1789181311.349856:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510012416 00000100:00100000:2.0:1789181311.349862:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510012416 00000100:00100000:2.0:1789181311.349890:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789181311.349897:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009a78b35d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+9:5823:x1876092510012416:12345-0@lo:503: 00000100:00100000:2.0:1789181311.350075:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009a78b35d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+9:5823:x1876092510012416:12345-0@lo:503: Request processed in 179us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181311.350083:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789181311.352047:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a7774192 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:5823:1876092510012416:0@lo:503: 00000100:00100000:2.0:1789181311.353057:0:5866:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002d829ba8 pname:cluuid:pid:xid:nid:opc:job llog_process_th:880710ad-110c-42a4-a174-ab1b99a7ebeb:5866:1876092510012544:0@lo:502: 00000100:00100000:2.0:1789181311.353133:0:5866:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181311.353201:0:5866:0:(client.c:2716:ptlrpc_set_wait()) set 000000008ffb2266 going to sleep for 11 seconds 00000100:00100000:3.0:1789181311.353361:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510012544 00000100:00100000:3.0:1789181311.353368:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510012544 00000100:00100000:3.0:1789181311.353412:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789181311.353421:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fbeaf471 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+9:5866:x1876092510012544:12345-0@lo:502: 00000100:00100000:3.0:1789181311.353699:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fbeaf471 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+9:5866:x1876092510012544:12345-0@lo:502: Request processed in 279us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181311.353707:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789181311.354118:0:5866:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002d829ba8 pname:cluuid:pid:xid:nid:opc:job llog_process_th:880710ad-110c-42a4-a174-ab1b99a7ebeb:5866:1876092510012544:0@lo:502: 00000020:01000000:2.0:1789181311.354149:0:5866:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789181311.354171:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789181311.354174:0:5866:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789181311.354181:0:5866:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1789181311.354184:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789181311.354199:0:5866:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000007b48c721) 00000020:00000080:2.0:1789181311.354220:0:5866:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1789181311.354225:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1789181311.354311:0:5866:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:2.0:1789181311.354318:0:5866:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8f4f7840b2e40e8a 00000020:00000080:2.0:1789181311.354573:0:5866:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1789181311.354578:0:5866:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789181311.354588:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789181311.354589:0:5866:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789181311.354593:0:5866:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789181311.354596:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789181311.354598:0:5866:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1789181311.354601:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789181311.354608:0:5866:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000009bf12820) 00000020:00000080:2.0:1789181311.354618:0:5866:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1789181311.354622:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1789181311.354623:0:5866:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1789181311.354626:0:5866:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1789181311.354642:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789181311.354950:0:5866:0:(tgt_mount.c:153:server_get_mount()) get mount 000000007c660436 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1789181311.354972:0:5866:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (0000000068fca83f) 00000020:00000080:2.0:1789181311.354981:0:5866:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1789181311.355055:0:5866:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1789181311.355061:0:5866:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8f4f7840b2e40e9f 00000020:00000080:2.0:1789181311.355303:0:5866:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1789181311.355311:0:5866:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1789181311.355315:0:5866:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x8f4f7840b2e40ea6 00080000:01000000:2.0:1789181311.355320:0:5866:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:2.0:1789181311.355323:0:5866:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8f4f7840b2e40ead 00080000:10000000:2.0:1789181311.358561:0:5866:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:2.0:1789181311.358888:0:5866:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1789181311.364417:0:5866:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:0.0:1789181311.477072:0:5866:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:0.0:1789181311.477615:0:5866:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:0.0:1789181311.492597:0:5866:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:0.0:1789181311.493505:0:5866:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00010000:3.0:1789181311.550560:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789181311.691773:0:5866:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000ad9f44ba) 00000020:00000080:0.0:1789181311.691801:0:5866:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1789181311.691922:0:5866:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:0.0:1789181311.691930:0:5866:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8f4f7840b2e40ebb 00000020:00000080:0.0:1789181311.699055:0:5866:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:0.0:1789181311.704976:0:5866:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:3.0:1789181311.782946:0:5866:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1789181311.891929:0:5866:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1789181312.011079:0:5866:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:3.0:1789181312.077354:0:5866:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:3.0:1789181312.136410:0:5866:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:3.0:1789181312.221064:0:5866:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x8f4f7840b2e40ec2 00000020:00000080:3.0:1789181312.221979:0:5866:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1789181312.221993:0:5866:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789181312.222000:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789181312.222002:0:5866:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1789181312.222005:0:5866:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789181312.222011:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789181312.222012:0:5866:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1789181312.222016:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1789181312.222054:0:5866:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1789181312.222066:0:5866:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789181312.222069:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789181312.222070:0:5866:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1789181312.222073:0:5866:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789181312.222087:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789181312.222089:0:5866:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789181312.222093:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789181312.222094:0:5866:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789181312.222256:0:5866:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001b00402b pname:cluuid:pid:xid:nid:opc:job llog_process_th:880710ad-110c-42a4-a174-ab1b99a7ebeb:5866:1876092510012672:0@lo:502: 00000100:00100000:3.0:1789181312.222355:0:5866:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181312.222465:0:5866:0:(client.c:2716:ptlrpc_set_wait()) set 0000000091f0b80e going to sleep for 11 seconds 00000100:00100000:0.0:1789181312.225007:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510012672 00000100:00100000:0.0:1789181312.225021:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510012672 00000100:00100000:0.0:1789181312.225112:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789181312.225121:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002c6dd65c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+9:5866:x1876092510012672:12345-0@lo:502: 00000100:00100000:0.0:1789181312.225918:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002c6dd65c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+9:5866:x1876092510012672:12345-0@lo:502: Request processed in 796us (3561us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181312.225926:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789181312.226033:0:5866:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001b00402b pname:cluuid:pid:xid:nid:opc:job llog_process_th:880710ad-110c-42a4-a174-ab1b99a7ebeb:5866:1876092510012672:0@lo:502: 00000020:01000000:3.0:1789181312.226067:0:5866:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789181312.226075:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789181312.226078:0:5866:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789181312.226082:0:5866:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1789181312.226323:0:5823:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1789181312.226365:0:5823:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.132@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789181312.226380:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.132@tcp lock: 0000000017bdd2c1/0x8f4f7840b2e40e75 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e40e7c expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181312.226404:0:5823:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.132@tcp lock: 0000000017bdd2c1/0x8f4f7840b2e40e75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e40e7c expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789181312.226412:0:5823:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9dc1add60800 from 1 10000000:01000000:1.0:1789181312.226424:0:5823:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789181312.226455:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.132@tcp lock: 000000003e628307/0x8f4f7840b2e40ec9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181312.226462:0:5823:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.132@tcp lock: 000000003e628307/0x8f4f7840b2e40ec9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181312.226471:0:5823:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.132@tcp lock: 000000003e628307/0x8f4f7840b2e40ec9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181312.226489:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a7774192 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:5823:1876092510012800:0@lo:101: 00000100:00100000:1.0:1789181312.226549:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181312.227356:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set 00000000225af265 going to sleep for 11 seconds 00000100:00100000:2.0:1789181312.227409:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510012800 00000100:00100000:2.0:1789181312.227425:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510012800 00000100:00100000:2.0:1789181312.227460:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789181312.227468:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000071aa57b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+9:5823:x1876092510012800:12345-0@lo:101: 00010000:00010000:2.0:1789181312.227479:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181312.227494:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004ae409e4/0x8f4f7840b2e40ed0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f4f7840b2e40ec9 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181312.227542:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004ae409e4/0x8f4f7840b2e40ed0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f4f7840b2e40ec9 expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181312.227552:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004ae409e4/0x8f4f7840b2e40ed0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e40ec9 expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181312.227561:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004ae409e4, rc 0) 00000100:00100000:2.0:1789181312.228001:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000071aa57b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+10:5823:x1876092510012800:12345-0@lo:101: Request processed in 532us (1450us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181312.228009:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789181312.228295:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a7774192 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:5823:1876092510012800:0@lo:101: 00010000:00010000:1.0:1789181312.228312:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.132@tcp lock: 000000003e628307/0x8f4f7840b2e40ec9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e40ed0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181312.228320:0:5823:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.132@tcp lock: 000000003e628307/0x8f4f7840b2e40ec9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f4f7840b2e40ed0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181312.236294:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000415081a pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:5823:1876092510012928:0@lo:256: 00000100:00100000:0.0:1789181312.236404:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181312.236468:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set 00000000491340ea going to sleep for 11 seconds 00000100:00100000:2.0:1789181312.236697:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510012928 00000100:00100000:2.0:1789181312.236706:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510012928 00000100:00100000:2.0:1789181312.236761:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789181312.236769:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000007b3c869 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+10:5823:x1876092510012928:12345-0@lo:256: 20000000:01000000:2.0:1789181312.236788:0:5835:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1789181312.236793:0:5835:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1789181312.236875:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000007b3c869 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+10:5823:x1876092510012928:12345-0@lo:256: Request processed in 107us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181312.236883:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789181312.237168:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000415081a pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:5823:1876092510012928:0@lo:256: 10000000:01000000:0.0:1789181312.238109:0:5823:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789181312.238219:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.132@tcp lock: 000000003e628307/0x8f4f7840b2e40ec9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e40ed0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181312.238233:0:5823:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.132@tcp lock: 000000003e628307/0x8f4f7840b2e40ec9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e40ed0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789181312.238241:0:5823:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9dc1add60800 from 1 10000000:01000000:0.0:1789181312.238244:0:5823:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789181312.238279:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.132@tcp lock: 00000000e9e8454f/0x8f4f7840b2e40ed7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181312.238286:0:5823:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.132@tcp lock: 00000000e9e8454f/0x8f4f7840b2e40ed7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181312.238294:0:5823:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.132@tcp lock: 00000000e9e8454f/0x8f4f7840b2e40ed7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181312.238309:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000415081a pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:5823:1876092510013056:0@lo:101: 00000100:00100000:0.0:1789181312.238367:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181312.238406:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set 00000000491340ea going to sleep for 11 seconds 00000100:00100000:1.0:1789181312.238678:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510013056 00000100:00100000:1.0:1789181312.238686:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510013056 00000100:00100000:1.0:1789181312.238732:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789181312.238739:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000671cd160 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+10:5823:x1876092510013056:12345-0@lo:101: 00010000:00010000:1.0:1789181312.238759:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181312.238771:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000592e5168/0x8f4f7840b2e40ede lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f4f7840b2e40ed7 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181312.238794:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000592e5168/0x8f4f7840b2e40ede lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f4f7840b2e40ed7 expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181312.238803:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000592e5168/0x8f4f7840b2e40ede lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e40ed7 expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181312.238811:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000592e5168, rc 0) 00000100:00100000:1.0:1789181312.238855:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000671cd160 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+11:5823:x1876092510013056:12345-0@lo:101: Request processed in 116us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181312.238861:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789181312.239099:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000415081a pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:5823:1876092510013056:0@lo:101: 00010000:00010000:0.0:1789181312.239112:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.132@tcp lock: 00000000e9e8454f/0x8f4f7840b2e40ed7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e40ede expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181312.239121:0:5823:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.132@tcp lock: 00000000e9e8454f/0x8f4f7840b2e40ed7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f4f7840b2e40ede expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181312.239183:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000415081a pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:5823:1876092510013184:0@lo:501: 00000100:00100000:0.0:1789181312.239216:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181312.239248:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set 00000000491340ea going to sleep for 11 seconds 00000100:00100000:2.0:1789181312.239363:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510013184 00000100:00100000:2.0:1789181312.239368:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510013184 00000100:00100000:2.0:1789181312.239399:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789181312.239405:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000193dbd4a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+11:5823:x1876092510013184:12345-0@lo:501: 00000100:00100000:2.0:1789181312.239951:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000193dbd4a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+11:5823:x1876092510013184:12345-0@lo:501: Request processed in 545us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181312.239959:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789181312.240383:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000415081a pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:5823:1876092510013184:0@lo:501: 00000100:00100000:0.0:1789181312.240430:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000415081a pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:5823:1876092510013312:0@lo:503: 00000100:00100000:0.0:1789181312.240471:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181312.240498:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set 00000000491340ea going to sleep for 11 seconds 00000100:00100000:1.0:1789181312.240684:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510013312 00000100:00100000:1.0:1789181312.240689:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510013312 00000100:00100000:1.0:1789181312.240730:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789181312.240736:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000afe4bcca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+11:5823:x1876092510013312:12345-0@lo:503: 00000040:00080000:1.0:1789181312.240774:0:5837:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789181312.240814:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000afe4bcca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+11:5823:x1876092510013312:12345-0@lo:503: Request processed in 78us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181312.240820:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789181312.246173:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000415081a pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:5823:1876092510013312:0@lo:503: 00000040:00080000:0.0:1789181312.248066:0:5870:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1789181312.248925:0:5823:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1789181312.248949:0:5823:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789181312.249003:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.132@tcp lock: 00000000e9e8454f/0x8f4f7840b2e40ed7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e40ede expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181312.249017:0:5823:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.132@tcp lock: 00000000e9e8454f/0x8f4f7840b2e40ed7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e40ede expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789181312.249087:0:5823:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789181312.249090:0:5823:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9dc1add60800 10000000:01000000:1.0:1789181312.249093:0:5823:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9dc1add60800 10000000:01000000:1.0:1789181312.249097:0:5823:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789181312.249102:0:5823:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9dc1add60800 from 1 10000000:01000000:1.0:1789181312.249105:0:5823:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789181312.249137:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.132@tcp lock: 00000000e0b93ee4/0x8f4f7840b2e40ee5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181312.249157:0:5823:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.132@tcp lock: 00000000e0b93ee4/0x8f4f7840b2e40ee5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181312.249168:0:5823:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.132@tcp lock: 00000000e0b93ee4/0x8f4f7840b2e40ee5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181312.249189:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a7774192 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:5823:1876092510013440:0@lo:101: 00000100:00100000:1.0:1789181312.249256:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181312.249307:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d3fd41aa going to sleep for 11 seconds 00000100:00100000:0.0:1789181312.249518:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510013440 00000100:00100000:0.0:1789181312.249535:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510013440 00000100:00100000:0.0:1789181312.249578:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789181312.249586:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c6afec69 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+11:5823:x1876092510013440:12345-0@lo:101: 00010000:00010000:0.0:1789181312.249598:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181312.249609:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000eaf5a6f4/0x8f4f7840b2e40eec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f4f7840b2e40ee5 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181312.249645:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000eaf5a6f4/0x8f4f7840b2e40eec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f4f7840b2e40ee5 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181312.249667:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000eaf5a6f4/0x8f4f7840b2e40eec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e40ee5 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181312.249675:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000eaf5a6f4, rc 0) 00000100:00100000:0.0:1789181312.249714:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c6afec69 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+12:5823:x1876092510013440:12345-0@lo:101: Request processed in 128us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181312.249720:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789181312.253784:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a7774192 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:5823:1876092510013440:0@lo:101: 00010000:00010000:1.0:1789181312.253818:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.132@tcp lock: 00000000e0b93ee4/0x8f4f7840b2e40ee5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e40eec expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181312.253831:0:5823:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.132@tcp lock: 00000000e0b93ee4/0x8f4f7840b2e40ee5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f4f7840b2e40eec expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181312.253914:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a7774192 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:5823:1876092510013568:0@lo:501: 00000100:00100000:1.0:1789181312.253982:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181312.254046:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d3fd41aa going to sleep for 11 seconds 00000100:00100000:2.0:1789181312.254843:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510013568 00000100:00100000:2.0:1789181312.254862:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510013568 00000100:00100000:2.0:1789181312.254906:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789181312.254914:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000041698e23 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+12:5823:x1876092510013568:12345-0@lo:501: 00000100:00100000:2.0:1789181312.255588:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000041698e23 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+12:5823:x1876092510013568:12345-0@lo:501: Request processed in 499us (1430us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181312.255599:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789181312.256487:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a7774192 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:5823:1876092510013568:0@lo:501: 00000100:00100000:1.0:1789181312.256897:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a7774192 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:5823:1876092510013696:0@lo:503: 00000100:00100000:1.0:1789181312.256967:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181312.257009:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d3fd41aa going to sleep for 11 seconds 00000100:00100000:2.0:1789181312.257179:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510013696 00000100:00100000:2.0:1789181312.257187:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510013696 00000100:00100000:2.0:1789181312.257228:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789181312.257236:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006d820ca1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+12:5823:x1876092510013696:12345-0@lo:503: 00000100:00100000:0.0:1789181312.262989:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006d820ca1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+12:5823:x1876092510013696:12345-0@lo:503: Request processed in 5743us (6011us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181312.263030:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789181312.265483:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a7774192 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:5823:1876092510013696:0@lo:503: 00000100:00100000:3.0:1789181312.269869:0:5871:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001b00402b pname:cluuid:pid:xid:nid:opc:job llog_process_th:880710ad-110c-42a4-a174-ab1b99a7ebeb:5871:1876092510013824:0@lo:502: 00000100:00100000:3.0:1789181312.269955:0:5871:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181312.270017:0:5871:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f3941dff going to sleep for 11 seconds 00000100:00100000:0.0:1789181312.271798:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510013824 00000100:00100000:0.0:1789181312.271813:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510013824 00000100:00100000:0.0:1789181312.271863:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789181312.271870:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e2a51589 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+12:5871:x1876092510013824:12345-0@lo:502: 00000100:00100000:0.0:1789181312.272215:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e2a51589 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+12:5871:x1876092510013824:12345-0@lo:502: Request processed in 344us (2259us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181312.272224:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789181312.272448:0:5871:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001b00402b pname:cluuid:pid:xid:nid:opc:job llog_process_th:880710ad-110c-42a4-a174-ab1b99a7ebeb:5871:1876092510013824:0@lo:502: 00000020:01000004:3.0:1789181312.272513:0:5871:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1789181312.272543:0:5871:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (0000000074d14bf8) 00000020:00000080:3.0:1789181312.272563:0:5871:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1789181312.272830:0:5871:0:(tgt_mount.c:153:server_get_mount()) get mount 000000007c660436 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789181312.272835:0:5871:0:(tgt_mount.c:187:server_put_mount()) put mount 000000007c660436 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789181312.272838:0:5871:0:(obd_mount.c:710:lustre_put_lsi()) put 000000007c660436 4 00010000:00080000:3.0:1789181312.272866:0:5871:0:(ldlm_lib.c:102:import_set_conn()) imp 000000002abd6e57@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.132@tcp at head 00010000:00010000:1.0:1789181312.284868:0:5871:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:1.0:1789181312.285094:0:5871:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1789181312.285133:0:5871:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789181312.285157:0:5871:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x8f4f7840b2e40efa 00000100:00080000:1.0:1789181312.285168:0:5871:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789181312.285179:0:5871:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000002abd6e57 using connection 192.168.204.132@tcp/0@lo 00000100:00100000:1.0:1789181312.285212:0:5871:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000a1872520 x1876092510013952/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789181312.285246:0:5871:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789181312.285505:0:5871:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000058f71968 pname:cluuid:pid:xid:nid:opc:job llog_process_th:880710ad-110c-42a4-a174-ab1b99a7ebeb:5871:1876092510014080:0@lo:502: 00000100:00100000:0.0:1789181312.285636:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a1872520 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876092510013952:0@lo:38: 00000100:00100000:0.0:1789181312.285707:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181312.285776:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510013952 00000100:00100000:0.0:1789181312.285783:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510013952 00000100:00100000:0.0:1789181312.285816:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789181312.285822:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000415081a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3302:x1876092510013952:12345-0@lo:38: 00000100:00100000:0.0:1789181312.285869:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000415081a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3302:x1876092510013952:12345-0@lo:38: Request processed in 46us (162us total) trans 0 rc -11/-11 00000100:00100000:0.0:1789181312.285876:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789181312.285913:0:3302:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789181312.285920:0:3302:0:(import.c:65:import_set_state_nolock()) 000000002abd6e57 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789181312.285924:0:3302:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1789181312.285926:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a1872520 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876092510013952:0@lo:38: 00000100:00100000:1.0:1789181312.286066:0:5871:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181312.286091:0:5871:0:(client.c:2716:ptlrpc_set_wait()) set 000000007cf1e407 going to sleep for 11 seconds 00000100:00100000:0.0:1789181312.286315:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510014080 00000100:00100000:0.0:1789181312.286320:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510014080 00000100:00100000:0.0:1789181312.286387:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789181312.286394:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000090642f87 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+12:5871:x1876092510014080:12345-0@lo:502: 00000100:00100000:0.0:1789181312.286779:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000090642f87 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+12:5871:x1876092510014080:12345-0@lo:502: Request processed in 385us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181312.286794:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789181312.286841:0:5871:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000058f71968 pname:cluuid:pid:xid:nid:opc:job llog_process_th:880710ad-110c-42a4-a174-ab1b99a7ebeb:5871:1876092510014080:0@lo:502: 00000040:00080000:0.0:1789181312.286870:0:5871:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:0.0:1789181312.286961:0:5823:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1789181312.286977:0:5823:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789181312.286993:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.132@tcp lock: 00000000e0b93ee4/0x8f4f7840b2e40ee5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e40eec expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181312.287003:0:5823:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.132@tcp lock: 00000000e0b93ee4/0x8f4f7840b2e40ee5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e40eec expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789181312.287058:0:5823:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789181312.287061:0:5823:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789181312.287062:0:5823:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789181312.287063:0:5823:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789181312.287064:0:5823:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789181312.287066:0:5823:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789181312.287067:0:5823:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789181312.287069:0:5823:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789181312.287070:0:5823:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789181312.287072:0:5823:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789181312.287073:0:5823:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789181312.287075:0:5823:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789181312.287078:0:5823:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1789181312.287081:0:5823:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789181312.287082:0:5823:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789181312.287083:0:5823:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789181312.287084:0:5823:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789181312.287085:0:5823:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789181312.287086:0:5823:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789181312.287087:0:5823:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789181312.287087:0:5823:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789181312.287088:0:5823:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789181312.287089:0:5823:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789181312.287095:0:5823:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789181312.287096:0:5823:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789181312.287112:0:5823:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789181312.287123:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000084ab65c8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:5823:1876092510014208:0@lo:253: 00000100:00100000:0.0:1789181312.287165:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181312.287191:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510014208 00000100:00100000:0.0:1789181312.287196:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510014208 00000100:00100000:0.0:1789181312.287219:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789181312.287225:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d7d5f40f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+12:5823:x1876092510014208:12345-0@lo:253: 20000000:01000000:0.0:1789181312.287244:0:5837:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1789181312.287257:0:5837:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1789181312.296262:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set 000000008852a846 going to sleep for 11 seconds 20000000:01000000:2.0:1789181312.375593:0:5837:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789181312.375654:0:5837:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1789181312.377046:0:5858:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789181312.377055:0:5858:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789181312.377077:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000411b3bd2/0x8f4f7840b2e40f01 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181312.377096:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000004ae409e4/0x8f4f7840b2e40ed0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e40ec9 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181312.377115:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000411b3bd2/0x8f4f7840b2e40f01 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181312.377172:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000004ae409e4/0x8f4f7840b2e40ed0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8f4f7840b2e40ec9 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181312.377186:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000004ae409e4/0x8f4f7840b2e40ed0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8f4f7840b2e40ec9 expref: 12 pid: 5835 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181312.377201:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003b0f739a pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5858:1876092510014336:0@lo:104: 00000100:00100000:1.0:1789181312.377275:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181312.377362:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bdfee012 going to sleep for 11 seconds 00000100:00100000:0.0:1789181312.377537:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510014336 00000100:00100000:0.0:1789181312.377546:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510014336 00000100:00100000:0.0:1789181312.377596:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789181312.377603:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008645c94b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:880710ad-110c-42a4-a174-ab1b99a7ebeb+3:5858:x1876092510014336:12345-0@lo:104: 00010000:00010000:0.0:1789181312.377626:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.132@tcp lock: 000000003e628307/0x8f4f7840b2e40ec9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f4f7840b2e40ed0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181312.377688:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789181312.377693:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008645c94b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:880710ad-110c-42a4-a174-ab1b99a7ebeb+3:5858:x1876092510014336:12345-0@lo:104: Request processed in 91us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181312.377700:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789181312.377920:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003b0f739a pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5858:1876092510014336:0@lo:104: 00010000:00010000:1.0:1789181312.377937:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000411b3bd2/0x8f4f7840b2e40f01 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181312.377989:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789181312.377994:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.132@tcp lock: 000000003e628307/0x8f4f7840b2e40ec9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f4f7840b2e40ed0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181312.378001:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003e628307 already unused, calling callback (00000000a9f78efc) 10000000:00010000:2.0:1789181312.378004:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.132@tcp lock: 000000003e628307/0x8f4f7840b2e40ec9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8f4f7840b2e40ed0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181312.378067:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.132@tcp lock: 000000003e628307/0x8f4f7840b2e40ec9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8f4f7840b2e40ed0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789181312.378075:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.132@tcp lock: 000000003e628307/0x8f4f7840b2e40ec9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8f4f7840b2e40ed0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789181312.378081:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789181312.378143:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.132@tcp lock: 000000003e628307/0x8f4f7840b2e40ec9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e40ed0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181312.378157:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789181312.378180:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.132@tcp lock: 000000003e628307/0x8f4f7840b2e40ec9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e40ed0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181312.378187:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.132@tcp lock: 000000003e628307/0x8f4f7840b2e40ec9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e40ed0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181312.378203:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181312.378204:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181312.378206:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789181312.378481:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002d829ba8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:880710ad-110c-42a4-a174-ab1b99a7ebeb:3304:1876092510014464:0@lo:103: 00000100:00100000:3.0:1789181312.378520:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181312.378565:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510014464 00000100:00100000:3.0:1789181312.378569:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510014464 00010000:00010000:3.0:1789181312.378585:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000004ae409e4/0x8f4f7840b2e40ed0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f4f7840b2e40ec9 expref: 13 pid: 5835 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181312.378605:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789181312.378623:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001b00402b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:880710ad-110c-42a4-a174-ab1b99a7ebeb+13:3304:x1876092510014464:12345-0@lo:103: 00010000:00010000:3.0:1789181312.378632:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789181312.378651:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000004ae409e4/0x8f4f7840b2e40ed0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f4f7840b2e40ec9 expref: 13 pid: 5835 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181312.378661:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000004ae409e4/0x8f4f7840b2e40ed0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8f4f7840b2e40ec9 expref: 13 pid: 5835 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181312.378673:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004ae409e4/0x8f4f7840b2e40ed0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8f4f7840b2e40ec9 expref: 13 pid: 5835 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181312.378685:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000411b3bd2/0x8f4f7840b2e40f01 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181312.378693:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000411b3bd2/0x8f4f7840b2e40f01 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789181312.378705:0:5827:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001651137s 00010000:00010000:3.0:1789181312.378708:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000411b3bd2/0x8f4f7840b2e40f01 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181312.378715:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000411b3bd2/0x8f4f7840b2e40f01 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181312.378720:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000411b3bd2/0x8f4f7840b2e40f01 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181312.378726:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000411b3bd2/0x8f4f7840b2e40f01 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181312.378730:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000411b3bd2 already unused, calling callback (00000000f784e0c9) 00010000:00010000:3.0:1789181312.378733:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000411b3bd2/0x8f4f7840b2e40f01 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181312.378739:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000411b3bd2/0x8f4f7840b2e40f01 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181312.378755:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000411b3bd2/0x8f4f7840b2e40f01 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181312.378763:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789181312.378788:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001b00402b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:880710ad-110c-42a4-a174-ab1b99a7ebeb+12:3304:x1876092510014464:12345-0@lo:103: Request processed in 178us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181312.378795:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789181312.378820:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002d829ba8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:880710ad-110c-42a4-a174-ab1b99a7ebeb:3304:1876092510014464:0@lo:103: 00010000:00010000:3.0:1789181312.378835:0:5858:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000411b3bd2/0x8f4f7840b2e40f01 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181312.378841:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000411b3bd2/0x8f4f7840b2e40f01 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181312.378846:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000411b3bd2/0x8f4f7840b2e40f01 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181312.385385:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d7d5f40f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+11:5823:x1876092510014208:12345-0@lo:253: Request processed in 98152us (98212us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181312.385401:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789181312.385582:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000084ab65c8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:5823:1876092510014208:0@lo:253: 10000000:01000000:1.0:1789181312.385599:0:5823:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789181312.385602:0:5823:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789181312.385604:0:5823:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789181312.385606:0:5823:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789181312.385607:0:5823:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789181312.385607:0:5823:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789181312.385609:0:5823:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789181312.385622:0:5823:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789181312.385623:0:5823:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789181312.385624:0:5823:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789181312.385626:0:5823:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789181312.385627:0:5823:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789181312.385629:0:5823:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789181312.385643:0:5823:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789181312.391988:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1789181312.392588:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789181312.392990:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1789181312.393829:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1789181312.394161:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1789181312.394359:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1789181312.395264:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1789181312.395534:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1789181312.395927:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1789181312.396191:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1789181312.396441:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1789181312.396589:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:0.0:1789181312.485462:0:5823:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:1.0:1789181312.513278:0:5823:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1789181312.513630:0:5877:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1789181312.516238:0:5823:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1789181312.516452:0:5823:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1789181312.516878:0:5823:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1789181312.516886:0:5823:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000020:00080000:3.0:1789181312.517312:0:5876:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1789181312.517317:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:00080000:1.0:1789181312.517497:0:5823:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789181312.518569:0:5823:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1789181312.519327:0:5823:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1789181312.519458:0:5823:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1789181312.519910:0:5823:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1789181312.520142:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:1.0:1789181312.527653:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1789181312.527798:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1789181312.527975:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1789181312.528117:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1789181312.528275:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1789181312.528446:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1789181312.528590:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1789181312.528758:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1789181312.528924:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1789181312.529056:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1789181312.529205:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1789181312.529380:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1789181312.537117:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1789181312.537281:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1789181312.537468:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1789181312.538917:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1789181312.539390:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1789181312.539570:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1789181312.539760:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1789181312.539924:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1789181312.540053:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1789181312.540217:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1789181312.540391:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1789181312.540570:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1789181312.540725:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1789181312.542019:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1789181312.542180:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1789181312.542326:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1789181312.549590:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1789181312.549885:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1789181312.550034:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1789181312.550168:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1789181312.550396:0:5823:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:0.0:1789181312.580110:0:5877:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00010000:00010000:3.0:1789181312.580431:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789181312.630848:0:5823:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1789181312.630901:0:5823:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffaf38c1c8f988 00100000:10000000:2.0:1789181312.630918:0:5823:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000040:00080000:1.0:1789181312.634634:0:5877:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789181312.634738:0:5877:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1789181312.634743:0:5877:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:01000004:2.0:1789181312.635135:0:5823:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789181312.635152:0:5823:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.132@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789181312.635164:0:5823:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1789181312.635181:0:5823:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:2.0:1789181313.598619:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181314.625016:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181315.646897:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181316.670573:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181317.630786:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:1.0:1789181317.630809:0:42:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789181317.630814:0:42:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789181317.630817:0:42:0:(import.c:65:import_set_state_nolock()) 000000002abd6e57 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789181317.630833:0:42:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000002abd6e57 using connection 192.168.204.132@tcp/0@lo 00000100:00100000:1.0:1789181317.630854:0:42:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000058d3e1f9 x1876092510014720/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789181317.630891:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000058d3e1f9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876092510014720:0@lo:38: 00000100:00100000:1.0:1789181317.630951:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181317.631555:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510014720 00000100:00100000:3.0:1789181317.631564:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510014720 00000100:00100000:3.0:1789181317.631764:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789181317.631772:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005915a17e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3302:x1876092510014720:12345-0@lo:38: 00010000:00080000:3.0:1789181317.631797:0:5844:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 209 last 0 00000020:00000080:3.0:1789181317.631831:0:5844:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x8f4f7840b2e40f08 00000004:00100000:3.0:1789181317.631871:0:5844:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789181317.631996:0:5844:0:(import.c:65:import_set_state_nolock()) 00000000f8d7efc8 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789181317.632053:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005915a17e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876092510014720:12345-0@lo:38: Request processed in 281us (1103us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181317.632061:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789181317.632106:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000058d3e1f9 x1876092510014720/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789181327 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789181317.632120:0:3302:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1789181317.632127:0:3302:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1789181317.632131:0:3302:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789181317.632133:0:3302:0:(import.c:65:import_set_state_nolock()) 000000002abd6e57 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789181317.632139:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000058d3e1f9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876092510014720:0@lo:38: 00000100:00100000:3.0:1789181317.637155:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003b0f739a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:880710ad-110c-42a4-a174-ab1b99a7ebeb:3306:1876092510014592:0@lo:400: 00000100:00100000:3.0:1789181317.637227:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181317.637422:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510014592 00000100:00100000:1.0:1789181317.637432:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510014592 00000100:00100000:1.0:1789181317.637481:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789181317.637490:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009c732d01 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+11:3306:x1876092510014592:12345-0@lo:400: 00000100:00100000:1.0:1789181317.637557:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009c732d01 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+11:3306:x1876092510014592:12345-0@lo:400: Request processed in 68us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181317.637564:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789181317.638020:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003b0f739a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:880710ad-110c-42a4-a174-ab1b99a7ebeb:3306:1876092510014592:0@lo:400: 00010000:00010000:0.0:1789181317.707955:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789181318.444304:0:6121:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg432-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789181318.727788:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789181319.168157:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789181319.168165:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9dc1add60800 from 3 10000000:01000000:2.0:1789181319.168169:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789181319.168219:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.132@tcp lock: 000000008a84c095/0x8f4f7840b2e40f0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181319.168233:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.132@tcp lock: 000000008a84c095/0x8f4f7840b2e40f0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181319.168244:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.132@tcp lock: 000000008a84c095/0x8f4f7840b2e40f0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181319.168265:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b42244bd pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510014848:0@lo:101: 00000100:00100000:2.0:1789181319.168458:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181319.168550:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set 000000003c38dc96 going to sleep for 11 seconds 00000100:00100000:0.0:1789181319.168590:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510014848 00000100:00100000:0.0:1789181319.168599:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510014848 00000100:00100000:0.0:1789181319.168686:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789181319.168693:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d63d1b2f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+11:5840:x1876092510014848:12345-0@lo:101: 00010000:00010000:0.0:1789181319.168706:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181319.168717:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000072ec7621/0x8f4f7840b2e40f16 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f4f7840b2e40f0f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181319.168740:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000072ec7621/0x8f4f7840b2e40f16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f4f7840b2e40f0f expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181319.168749:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000072ec7621/0x8f4f7840b2e40f16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e40f0f expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181319.168758:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000072ec7621, rc 0) 00000100:00100000:0.0:1789181319.168794:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d63d1b2f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+12:5840:x1876092510014848:12345-0@lo:101: Request processed in 102us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181319.168801:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789181319.168882:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b42244bd pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510014848:0@lo:101: 00010000:00010000:0.0:1789181319.168899:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.132@tcp lock: 000000008a84c095/0x8f4f7840b2e40f0f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e40f16 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181319.168907:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.132@tcp lock: 000000008a84c095/0x8f4f7840b2e40f0f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f4f7840b2e40f16 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181319.168952:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005319e13c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510014976:0@lo:256: 00000100:00100000:0.0:1789181319.168980:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181319.169028:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set 00000000633de44b going to sleep for 11 seconds 00000100:00100000:2.0:1789181319.169127:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510014976 00000100:00100000:2.0:1789181319.169131:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510014976 00000100:00100000:2.0:1789181319.169189:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789181319.169195:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000579c83e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+12:5840:x1876092510014976:12345-0@lo:256: 20000000:01000000:2.0:1789181319.169208:0:5836:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789181319.169222:0:5836:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789181319.169225:0:5836:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1789181319.169287:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000579c83e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+12:5840:x1876092510014976:12345-0@lo:256: Request processed in 92us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181319.169297:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789181319.169445:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005319e13c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510014976:0@lo:256: 10000000:01000000:0.0:1789181319.169498:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789181319.169508:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.132@tcp lock: 000000008a84c095/0x8f4f7840b2e40f0f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e40f16 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181319.169516:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.132@tcp lock: 000000008a84c095/0x8f4f7840b2e40f0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e40f16 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181319.750694:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181320.766633:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181321.790427:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181322.754540:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789181322.754560:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002644aa17 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:880710ad-110c-42a4-a174-ab1b99a7ebeb:3305:1876092510015104:0@lo:400: 00000100:00100000:1.0:1789181322.754623:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181322.754680:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a2a2f228 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876092510015232:0@lo:400: 00000100:00100000:1.0:1789181322.754704:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181322.754736:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510015104 00000100:00100000:1.0:1789181322.754744:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510015104 00000100:00100000:1.0:1789181322.754785:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789181322.754793:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000380039e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+12:3305:x1876092510015104:12345-0@lo:400: 00000100:00100000:1.0:1789181322.754840:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000380039e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+12:3305:x1876092510015104:12345-0@lo:400: Request processed in 48us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181322.754847:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789181322.754885:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510015232 00000100:00100000:1.0:1789181322.754888:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510015232 00000100:00100000:1.0:1789181322.754912:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789181322.754916:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000c6812c8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876092510015232:12345-0@lo:400: 00000100:00100000:1.0:1789181322.754948:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000c6812c8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876092510015232:12345-0@lo:400: Request processed in 32us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181322.754953:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789181322.755003:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000a2a2f228 x1876092510015232/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181338 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181322.755031:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a2a2f228 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876092510015232:0@lo:400: 00000100:00100000:1.0:1789181322.755057:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002644aa17 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:880710ad-110c-42a4-a174-ab1b99a7ebeb:3305:1876092510015104:0@lo:400: 00010000:00010000:0.0:1789181322.822838:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181323.859047:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789181324.271682:0:6323:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe63bc8ce0 20000000:00000080:2.0:1789181324.271706:0:6323:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9dc1878d9800 uarg=0000000000000000 20000000:01000000:2.0:1789181324.271797:0:6323:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1789181324.271804:0:6323:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1789181324.271810:0:6323:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1789181324.272027:0:6323:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1789181324.272040:0:6323:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1789181324.280290:0:6323:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789181324.281832:0:6323:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1789181324.281909:0:6323:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1789181324.281962:0:6323:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1789181324.281981:0:6323:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789181324.282000:0:6323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000004de1ab48/0x8f4f7840b2e40f1d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181324.282019:0:6323:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000592e5168/0x8f4f7840b2e40ede lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e40ed7 expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181324.282027:0:6323:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000004de1ab48/0x8f4f7840b2e40f1d lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181324.282066:0:6323:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000592e5168/0x8f4f7840b2e40ede lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8f4f7840b2e40ed7 expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181324.282081:0:6323:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000592e5168/0x8f4f7840b2e40ede lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8f4f7840b2e40ed7 expref: 11 pid: 5837 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181324.282107:0:6323:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f626dac6 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6323:1876092510015360:0@lo:104: 00000100:00100000:2.0:1789181324.282170:0:6323:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181324.282222:0:6323:0:(client.c:2716:ptlrpc_set_wait()) set 000000008c6ab962 going to sleep for 11 seconds 00000100:00100000:1.0:1789181324.284181:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510015360 00000100:00100000:1.0:1789181324.284196:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510015360 00000100:00100000:1.0:1789181324.284273:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789181324.284283:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a4f0e7d4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:880710ad-110c-42a4-a174-ab1b99a7ebeb+3:6323:x1876092510015360:12345-0@lo:104: 00010000:00010000:1.0:1789181324.284299:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.132@tcp lock: 00000000e9e8454f/0x8f4f7840b2e40ed7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f4f7840b2e40ede expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181324.284440:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789181324.284447:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a4f0e7d4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:880710ad-110c-42a4-a174-ab1b99a7ebeb+3:6323:x1876092510015360:12345-0@lo:104: Request processed in 166us (2277us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181324.284454:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789181324.284570:0:6323:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f626dac6 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6323:1876092510015360:0@lo:104: 00010000:00010000:2.0:1789181324.284594:0:6323:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000004de1ab48/0x8f4f7840b2e40f1d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181324.284923:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789181324.284931:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.132@tcp lock: 00000000e9e8454f/0x8f4f7840b2e40ed7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f4f7840b2e40ede expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181324.284940:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e9e8454f already unused, calling callback (00000000a9f78efc) 10000000:00010000:0.0:1789181324.284943:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.132@tcp lock: 00000000e9e8454f/0x8f4f7840b2e40ed7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8f4f7840b2e40ede expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181324.284952:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.132@tcp lock: 00000000e9e8454f/0x8f4f7840b2e40ed7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8f4f7840b2e40ede expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789181324.284959:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.132@tcp lock: 00000000e9e8454f/0x8f4f7840b2e40ed7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8f4f7840b2e40ede expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789181324.284964:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789181324.285018:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.132@tcp lock: 00000000e9e8454f/0x8f4f7840b2e40ed7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e40ede expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181324.285026:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789181324.285045:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.132@tcp lock: 00000000e9e8454f/0x8f4f7840b2e40ed7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e40ede expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181324.285051:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.132@tcp lock: 00000000e9e8454f/0x8f4f7840b2e40ed7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e40ede expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181324.285084:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181324.285086:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181324.285088:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181324.285144:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005319e13c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:880710ad-110c-42a4-a174-ab1b99a7ebeb:3304:1876092510015488:0@lo:103: 00000100:00100000:1.0:1789181324.285186:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181324.285413:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510015488 00000100:00100000:0.0:1789181324.285429:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510015488 00010000:00010000:0.0:1789181324.285452:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000592e5168/0x8f4f7840b2e40ede lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f4f7840b2e40ed7 expref: 12 pid: 5837 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181324.285481:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789181324.285488:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002644aa17 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:880710ad-110c-42a4-a174-ab1b99a7ebeb+12:3304:x1876092510015488:12345-0@lo:103: 00010000:00010000:0.0:1789181324.285498:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789181324.285502:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000592e5168/0x8f4f7840b2e40ede lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f4f7840b2e40ed7 expref: 12 pid: 5837 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181324.285511:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000592e5168/0x8f4f7840b2e40ede lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8f4f7840b2e40ed7 expref: 12 pid: 5837 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181324.285523:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000592e5168/0x8f4f7840b2e40ede lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8f4f7840b2e40ed7 expref: 12 pid: 5837 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181324.285536:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000004de1ab48/0x8f4f7840b2e40f1d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181324.285543:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004de1ab48/0x8f4f7840b2e40f1d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181324.285558:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000004de1ab48/0x8f4f7840b2e40f1d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181324.285565:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000004de1ab48/0x8f4f7840b2e40f1d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181324.285577:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000004de1ab48/0x8f4f7840b2e40f1d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181324.285583:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000004de1ab48/0x8f4f7840b2e40f1d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181324.285588:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004de1ab48 already unused, calling callback (00000000f784e0c9) 00010000:00010000:0.0:1789181324.285590:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000004de1ab48/0x8f4f7840b2e40f1d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181324.285597:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000004de1ab48/0x8f4f7840b2e40f1d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181324.285618:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000004de1ab48/0x8f4f7840b2e40f1d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181324.285628:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789181324.285660:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002644aa17 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:880710ad-110c-42a4-a174-ab1b99a7ebeb+11:3304:x1876092510015488:12345-0@lo:103: Request processed in 174us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181324.285667:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789181324.285894:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005319e13c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:880710ad-110c-42a4-a174-ab1b99a7ebeb:3304:1876092510015488:0@lo:103: 00010000:00010000:1.0:1789181324.285921:0:6323:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000004de1ab48/0x8f4f7840b2e40f1d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181324.285928:0:6323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000004de1ab48/0x8f4f7840b2e40f1d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181324.285933:0:6323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004de1ab48/0x8f4f7840b2e40f1d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181324.862556:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789181324.926547:0:5840:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789181324.926555:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9dc1add60800 from 1 10000000:01000000:2.0:1789181324.926559:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789181324.926617:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.132@tcp lock: 00000000a5a998de/0x8f4f7840b2e40f24 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181324.926630:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.132@tcp lock: 00000000a5a998de/0x8f4f7840b2e40f24 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181324.926640:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.132@tcp lock: 00000000a5a998de/0x8f4f7840b2e40f24 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181324.926666:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f626dac6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510015616:0@lo:101: 00000100:00100000:2.0:1789181324.926737:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181324.926796:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set 000000008c6ab962 going to sleep for 11 seconds 00000100:00100000:0.0:1789181324.926932:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510015616 00000100:00100000:0.0:1789181324.926941:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510015616 00000100:00100000:0.0:1789181324.926994:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789181324.927002:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006297d278 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+11:5840:x1876092510015616:12345-0@lo:101: 00010000:00010000:0.0:1789181324.927015:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181324.927028:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000024d205de/0x8f4f7840b2e40f2b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f4f7840b2e40f24 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181324.927052:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000024d205de/0x8f4f7840b2e40f2b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f4f7840b2e40f24 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181324.927071:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000024d205de/0x8f4f7840b2e40f2b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e40f24 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181324.927080:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000024d205de, rc 0) 00000100:00100000:0.0:1789181324.927120:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006297d278 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+12:5840:x1876092510015616:12345-0@lo:101: Request processed in 120us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181324.927127:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789181324.927172:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f626dac6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510015616:0@lo:101: 00010000:00010000:0.0:1789181324.927185:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.132@tcp lock: 00000000a5a998de/0x8f4f7840b2e40f24 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e40f2b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181324.927193:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.132@tcp lock: 00000000a5a998de/0x8f4f7840b2e40f24 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f4f7840b2e40f2b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181324.927243:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004eac50c7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510015744:0@lo:501: 00000100:00100000:0.0:1789181324.927280:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181324.927295:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set 000000006a90990b going to sleep for 11 seconds 00000100:00100000:0.0:1789181324.927308:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510015744 00000100:00100000:0.0:1789181324.927311:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510015744 00000100:00100000:0.0:1789181324.927348:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789181324.927353:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007a689897 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+12:5840:x1876092510015744:12345-0@lo:501: 00000100:00100000:0.0:1789181324.927615:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007a689897 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+12:5840:x1876092510015744:12345-0@lo:501: Request processed in 260us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181324.927621:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789181324.927651:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004eac50c7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510015744:0@lo:501: 00000100:00100000:0.0:1789181324.927675:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004eac50c7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510015872:0@lo:503: 00000100:00100000:0.0:1789181324.927713:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181324.927725:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set 000000006a90990b going to sleep for 11 seconds 00000100:00100000:0.0:1789181324.927735:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510015872 00000100:00100000:0.0:1789181324.927739:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510015872 00000100:00100000:0.0:1789181324.927757:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789181324.927762:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000032f13021 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+12:5840:x1876092510015872:12345-0@lo:503: 00000100:00100000:0.0:1789181324.927876:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000032f13021 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+12:5840:x1876092510015872:12345-0@lo:503: Request processed in 114us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181324.927883:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789181324.927917:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004eac50c7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510015872:0@lo:503: 00000100:00100000:0.0:1789181324.928881:0:6342:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004eac50c7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:880710ad-110c-42a4-a174-ab1b99a7ebeb:6342:1876092510016000:0@lo:502: 00000100:00100000:0.0:1789181324.928927:0:6342:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181324.928993:0:6342:0:(client.c:2716:ptlrpc_set_wait()) set 000000006be8d594 going to sleep for 11 seconds 00000100:00100000:2.0:1789181324.931596:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510016000 00000100:00100000:2.0:1789181324.931611:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510016000 00000100:00100000:2.0:1789181324.931712:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789181324.931722:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000964b4c96 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+12:6342:x1876092510016000:12345-0@lo:502: 00000100:00100000:2.0:1789181324.931976:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000964b4c96 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+12:6342:x1876092510016000:12345-0@lo:502: Request processed in 255us (3048us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181324.931994:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789181324.932079:0:6342:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004eac50c7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:880710ad-110c-42a4-a174-ab1b99a7ebeb:6342:1876092510016000:0@lo:502: 00000020:01000000:1.0:1789181324.932114:0:6342:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789181324.932125:0:6342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789181324.932128:0:6342:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789181324.932133:0:6342:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dc1add60800 00000020:00000080:1.0:1789181324.932136:0:6342:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789181324.932188:0:6342:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1baba6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:880710ad-110c-42a4-a174-ab1b99a7ebeb:6342:1876092510016128:0@lo:502: 00000100:00100000:1.0:1789181324.932236:0:6342:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181324.932828:0:6342:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc19c251e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789181324.932911:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510016128 00000100:00100000:0.0:1789181324.932918:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510016128 00000100:00100000:0.0:1789181324.932947:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789181324.932955:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+12:6342:x1876092510016128:12345-0@lo:502: 00000100:00100000:0.0:1789181324.933161:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+12:6342:x1876092510016128:12345-0@lo:502: Request processed in 206us (923us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181324.933169:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789181324.933474:0:6342:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1baba6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:880710ad-110c-42a4-a174-ab1b99a7ebeb:6342:1876092510016128:0@lo:502: 00000020:01000000:1.0:1789181324.933499:0:6342:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789181324.933506:0:6342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789181324.933508:0:6342:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1789181324.933512:0:6342:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1789181324.933744:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1789181324.933762:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789181324.933773:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc18151b600/0x8f4f7840b2e40f24 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e40f2b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181324.933785:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.132@tcp lock: ffff9dc18151b600/0x8f4f7840b2e40f24 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e40f2b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181325.886587:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181326.910736:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181327.871028:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1baba6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:880710ad-110c-42a4-a174-ab1b99a7ebeb:3305:1876092510016256:0@lo:400: 00000100:00100000:1.0:1789181327.871251:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181327.871325:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789181327.871350:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1baba7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876092510016384:0@lo:400: 00000100:00100000:1.0:1789181327.871380:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181327.871425:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510016256 00000100:00100000:1.0:1789181327.871437:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510016256 00000100:00100000:1.0:1789181327.871491:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789181327.871500:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+12:3305:x1876092510016256:12345-0@lo:400: 00000100:00100000:1.0:1789181327.871551:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+12:3305:x1876092510016256:12345-0@lo:400: Request processed in 52us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181327.871558:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789181327.871588:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510016384 00000100:00100000:1.0:1789181327.871604:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510016384 00000100:00100000:1.0:1789181327.871631:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789181327.871638:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1baba4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876092510016384:12345-0@lo:400: 00000100:00100000:1.0:1789181327.871675:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1baba4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876092510016384:12345-0@lo:400: Request processed in 38us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181327.871681:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789181327.871723:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9dc1baba7800 x1876092510016384/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181343 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181327.871739:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1baba7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876092510016384:0@lo:400: 00000100:00100000:1.0:1789181327.871754:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1baba6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:880710ad-110c-42a4-a174-ab1b99a7ebeb:3305:1876092510016256:0@lo:400: 00010000:00010000:0.0:1789181327.934592:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181328.958528:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181329.982531:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789181330.519415:0:6689:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789181330.519419:0:6689:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1789181330.519552:0:6689:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9dc189d1d800 00000020:01000004:2.0:1789181330.519570:0:6689:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1789181330.519580:0:6689:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1789181330.519594:0:6689:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9dc1babc8000) 00000020:00000080:2.0:1789181330.519609:0:6689:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1789181330.534593:0:6689:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1789181330.534987:0:6689:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1789181330.570179:0:6689:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1789181330.578614:0:6689:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1789181330.578716:0:6689:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1789181330.578771:0:6689:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1789181330.578905:0:6689:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1789181330.579229:0:6689:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1789181330.579239:0:6689:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789181330.579257:0:6689:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x8f4f7840b2e40f39 00000020:01000004:3.0:1789181330.579762:0:6689:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1789181330.579787:0:6689:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.132@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789181330.579948:0:6689:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.132@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789181330.579957:0:6689:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1789181330.579963:0:6689:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1789181330.579976:0:6689:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9dc1898bcd40) 00000020:00000080:3.0:1789181330.579988:0:6689:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1789181330.581184:0:6689:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789181330.581378:0:6689:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1789181330.581392:0:6689:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1789181330.582691:0:6689:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1789181330.582700:0:6689:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1789181330.583152:0:6689:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1789181330.583158:0:6689:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1789181330.585483:0:6689:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789181330.586231:0:6689:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1789181330.586239:0:6689:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1789181330.591617:0:6689:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1789181330.591640:0:6689:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1789181330.625444:0:6689:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789181330.625699:0:6689:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789181330.625706:0:6689:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1789181330.628952:0:6689:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789181330.628967:0:6689:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1789181330.630890:0:6689:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1789181330.630905:0:6689:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1789181330.637931:0:6689:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789181330.638112:0:6689:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1789181330.638117:0:6689:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1789181330.638936:0:6689:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1789181330.638944:0:6689:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1789181330.692601:0:6689:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789181330.693019:0:6689:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1789181330.693025:0:6689:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1789181330.695036:0:6689:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1789181330.695057:0:6689:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1789181330.695986:0:6689:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1789181330.696010:0:6689:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1789181330.696016:0:6689:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.132@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1789181330.721977:0:6689:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.132@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789181330.722020:0:6689:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.132@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1789181330.722024:0:6689:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789181330.722025:0:6689:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789181330.722027:0:6689:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789181330.722028:0:6689:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789181330.722030:0:6689:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789181330.722031:0:6689:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789181330.722033:0:6689:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789181330.722034:0:6689:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789181330.722035:0:6689:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789181330.722037:0:6689:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789181330.722038:0:6689:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789181330.722041:0:6689:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1789181330.722043:0:6689:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789181330.722044:0:6689:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789181330.722045:0:6689:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789181330.722046:0:6689:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789181330.722047:0:6689:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789181330.722049:0:6689:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789181330.722050:0:6689:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789181330.722051:0:6689:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789181330.722052:0:6689:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789181330.722053:0:6689:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789181330.722054:0:6689:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789181330.722076:0:6689:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789181330.722093:0:6689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc18854bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:6689:1876092510016512:0@lo:253: 00000100:00100000:2.0:1789181330.722163:0:6689:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181330.722292:0:6689:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc189de5300 going to sleep for 11 seconds 00000100:00100000:0.0:1789181330.722702:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510016512 00000100:00100000:0.0:1789181330.722717:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510016512 00000100:00100000:0.0:1789181330.723565:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789181330.723579:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+12:6689:x1876092510016512:12345-0@lo:253: 20000000:01000000:0.0:1789181330.723610:0:5835:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1789181330.723614:0:5835:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1789181330.723619:0:5835:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1789181330.723623:0:5835:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1789181330.724517:0:5835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789181330.724718:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1789181330.724732:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1789181330.724767:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:0.0:1789181330.724774:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1789181330.724805:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:0.0:1789181330.724854:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:0.0:1789181330.725175:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1789181330.725192:0:5835:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.132@tcp 20000000:01000000:0.0:1789181330.725194:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.132@tcp (null) (null) (null) 00000040:00080000:0.0:1789181330.725223:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1789181330.725229:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789181330.725280:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1789181330.725289:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.204.132@tcp (null) (null) 00000040:00080000:0.0:1789181330.725318:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1789181330.725326:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1789181330.725385:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1789181330.725435:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:0.0:1789181330.726154:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1789181330.726172:0:5835:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.132@tcp 20000000:01000000:0.0:1789181330.726174:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.132@tcp (null) (null) (null) 00000040:00080000:0.0:1789181330.726209:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1789181330.726216:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1789181330.726245:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1789181330.729964:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.204.132@tcp (null) (null) 00000040:00080000:0.0:1789181330.730118:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1789181330.730129:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1789181330.730158:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:0.0:1789181330.730189:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:0.0:1789181330.730209:0:5835:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:0.0:1789181330.730212:0:5835:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:0.0:1789181330.730218:0:5835:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1789181330.730219:0:5835:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1789181330.730222:0:5835:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1789181330.730234:0:5835:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1789181330.730236:0:5835:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1789181330.730550:0:5835:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1789181330.730554:0:5835:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789181330.731582:0:6704:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1789181330.732074:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:0.0:1789181330.732122:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:0.0:1789181330.732187:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:0.0:1789181330.732199:0:5835:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1789181330.732202:0:5835:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789181330.733344:0:6705:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1789181330.733406:0:6705:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1789181330.733450:0:6705:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1789181330.733761:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1789181330.733815:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1789181330.734001:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1789181330.734013:0:5835:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1789181330.734015:0:5835:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789181330.734742:0:6706:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 10 1->4: lustre sys.timeout 20000000:01000000:0.0:1789181330.734801:0:6706:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 10 2->4: lustre sys.timeout 00000040:00080000:0.0:1789181330.735015:0:6706:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1789181330.735302:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:1.0:1789181330.735472:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:1.0:1789181330.735507:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 10000000:01000000:1.0:1789181330.735523:0:5835:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789181330.735543:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dc1c2045c00/0x8f4f7840b2e40f47 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181330.735562:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dc180030c00/0x8f4f7840b2e40e60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e40e59 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181330.735569:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dc180031a00/0x8f4f7840b2e40e7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e40e75 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181330.735575:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dc180031e00/0x8f4f7840b2e40eec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e40ee5 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181330.735581:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9dc1c2045c00/0x8f4f7840b2e40f47 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181330.735698:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dc180031e00/0x8f4f7840b2e40eec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8f4f7840b2e40ee5 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181330.735713:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dc180031e00/0x8f4f7840b2e40eec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8f4f7840b2e40ee5 expref: 12 pid: 5837 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181330.735727:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1baba6300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5835:1876092510016640:0@lo:104: 00000100:00100000:1.0:1789181330.735952:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789181330.736085:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dc180031a00/0x8f4f7840b2e40e7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8f4f7840b2e40e75 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181330.736094:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dc180031a00/0x8f4f7840b2e40e7c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8f4f7840b2e40e75 expref: 12 pid: 5836 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181330.736104:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1baba6d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5835:1876092510016768:0@lo:104: 00000100:00100000:1.0:1789181330.736124:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789181330.736617:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dc180030c00/0x8f4f7840b2e40e60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8f4f7840b2e40e59 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181330.736626:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dc180030c00/0x8f4f7840b2e40e60 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8f4f7840b2e40e59 expref: 12 pid: 5836 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181330.736645:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1baba7b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5835:1876092510016896:0@lo:104: 00000100:00100000:1.0:1789181330.736667:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181330.736765:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510016640 00000100:00100000:3.0:1789181330.736773:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510016640 00000100:00100000:3.0:1789181330.736916:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510016768 00000100:00100000:3.0:1789181330.736920:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510016768 00000100:00100000:3.0:1789181330.736938:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789181330.736945:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1baba7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:880710ad-110c-42a4-a174-ab1b99a7ebeb+4:5835:x1876092510016640:12345-0@lo:104: 00010000:00010000:3.0:1789181330.736965:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.132@tcp lock: ffff9dc1c2044000/0x8f4f7840b2e40ee5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f4f7840b2e40eec expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181330.737046:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789181330.737053:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1baba7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:880710ad-110c-42a4-a174-ab1b99a7ebeb+4:5835:x1876092510016640:12345-0@lo:104: Request processed in 107us (1263us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181330.737060:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789181330.737076:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789181330.737082:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1baba5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:880710ad-110c-42a4-a174-ab1b99a7ebeb+3:5835:x1876092510016768:12345-0@lo:104: 00010000:00010000:3.0:1789181330.737089:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.132@tcp lock: ffff9dc1c2044600/0x8f4f7840b2e40e75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f4f7840b2e40e7c expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181330.737144:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1988e9c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789181330.737162:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1baba6300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5835:1876092510016640:0@lo:104: 00000100:00100000:1.0:1789181330.737170:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1baba6d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5835:1876092510016768:0@lo:104: 00000100:00100000:0.0:1789181330.737214:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510016896 00000100:00100000:0.0:1789181330.737218:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510016896 00010000:00010000:2.0:1789181330.737270:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789181330.737546:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.132@tcp lock: ffff9dc1c2044000/0x8f4f7840b2e40ee5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f4f7840b2e40eec expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181330.737555:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1c2044000 already unused, calling callback (ffffffffc1b45c20) 10000000:00010000:2.0:1789181330.737559:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.132@tcp lock: ffff9dc1c2044000/0x8f4f7840b2e40ee5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8f4f7840b2e40eec expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181330.737579:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.132@tcp lock: ffff9dc1c2044000/0x8f4f7840b2e40ee5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8f4f7840b2e40eec expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789181330.737586:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.132@tcp lock: ffff9dc1c2044000/0x8f4f7840b2e40ee5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8f4f7840b2e40eec expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789181330.737592:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789181330.738581:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.132@tcp lock: ffff9dc1c2044000/0x8f4f7840b2e40ee5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e40eec expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181330.738594:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789181330.738652:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc188548380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:880710ad-110c-42a4-a174-ab1b99a7ebeb:3303:1876092510017024:0@lo:103: 00000100:00100000:1.0:1789181330.738703:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789181330.738868:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.132@tcp lock: ffff9dc1c2044000/0x8f4f7840b2e40ee5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e40eec expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181330.738877:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.132@tcp lock: ffff9dc1c2044000/0x8f4f7840b2e40ee5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e40eec expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181330.738904:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789181330.738908:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.132@tcp lock: ffff9dc1c2044600/0x8f4f7840b2e40e75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f4f7840b2e40e7c expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181330.738914:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1c2044600 already unused, calling callback (ffffffffc1b45c20) 10000000:00010000:2.0:1789181330.738918:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.132@tcp lock: ffff9dc1c2044600/0x8f4f7840b2e40e75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8f4f7840b2e40e7c expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181330.738926:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.132@tcp lock: ffff9dc1c2044600/0x8f4f7840b2e40e75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8f4f7840b2e40e7c expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789181330.738933:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.132@tcp lock: ffff9dc1c2044600/0x8f4f7840b2e40e75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8f4f7840b2e40e7c expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789181330.738946:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1789181330.739000:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510017024 00000100:00100000:0.0:1789181330.739006:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510017024 00010000:00010000:0.0:1789181330.739030:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dc180031e00/0x8f4f7840b2e40eec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f4f7840b2e40ee5 expref: 13 pid: 5837 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181330.739066:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789181330.739073:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1baba5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:880710ad-110c-42a4-a174-ab1b99a7ebeb+13:3303:x1876092510017024:12345-0@lo:103: 00010000:00010000:0.0:1789181330.739084:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789181330.739089:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dc180031e00/0x8f4f7840b2e40eec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f4f7840b2e40ee5 expref: 13 pid: 5837 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181330.739099:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dc180031e00/0x8f4f7840b2e40eec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8f4f7840b2e40ee5 expref: 13 pid: 5837 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181330.739115:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc180031e00/0x8f4f7840b2e40eec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8f4f7840b2e40ee5 expref: 13 pid: 5837 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181330.739128:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789181330.739193:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:3.0:1789181330.739202:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1baba5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:880710ad-110c-42a4-a174-ab1b99a7ebeb+4:5835:x1876092510016768:12345-0@lo:104: Request processed in 2119us (3075us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181330.739210:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789181330.739227:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789181330.739234:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1baba4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:880710ad-110c-42a4-a174-ab1b99a7ebeb+3:5835:x1876092510016896:12345-0@lo:104: 00010000:00010000:3.0:1789181330.739243:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.132@tcp lock: ffff9dc1c2045600/0x8f4f7840b2e40e59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f4f7840b2e40e60 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181330.739293:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789181330.739306:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1baba4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:880710ad-110c-42a4-a174-ab1b99a7ebeb+3:5835:x1876092510016896:12345-0@lo:104: Request processed in 66us (2630us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181330.739318:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789181330.739365:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1baba7b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5835:1876092510016896:0@lo:104: 00010000:00010000:3.0:1789181330.739392:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9dc1c2045c00/0x8f4f7840b2e40f47 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181330.739836:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.132@tcp lock: ffff9dc1c2044600/0x8f4f7840b2e40e75 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e40e7c expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181330.739844:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789181330.739851:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.132@tcp lock: ffff9dc1c2044600/0x8f4f7840b2e40e75 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e40e7c expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181330.739858:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.132@tcp lock: ffff9dc1c2044600/0x8f4f7840b2e40e75 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e40e7c expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181330.739872:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789181330.739876:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.132@tcp lock: ffff9dc1c2045600/0x8f4f7840b2e40e59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f4f7840b2e40e60 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181330.739882:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1c2045600 already unused, calling callback (ffffffffc1b45c20) 10000000:00010000:2.0:1789181330.739885:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.132@tcp lock: ffff9dc1c2045600/0x8f4f7840b2e40e59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8f4f7840b2e40e60 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181330.739893:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.132@tcp lock: ffff9dc1c2045600/0x8f4f7840b2e40e59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8f4f7840b2e40e60 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789181330.739900:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.132@tcp lock: ffff9dc1c2045600/0x8f4f7840b2e40e59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8f4f7840b2e40e60 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789181330.739906:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789181330.739916:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.132@tcp lock: ffff9dc1c2045600/0x8f4f7840b2e40e59 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e40e60 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181330.739921:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789181330.739939:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.132@tcp lock: ffff9dc1c2045600/0x8f4f7840b2e40e59 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e40e60 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181330.739946:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.132@tcp lock: ffff9dc1c2045600/0x8f4f7840b2e40e59 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e40e60 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181330.739959:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181330.739961:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181330.739962:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181330.739968:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789181330.739978:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc188549880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:880710ad-110c-42a4-a174-ab1b99a7ebeb:3306:1876092510017280:0@lo:103: 00000100:00100000:2.0:1789181330.740008:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181330.740593:0:5829:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1789181330.740603:0:5829:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1789181330.740643:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc188549f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:880710ad-110c-42a4-a174-ab1b99a7ebeb:3304:1876092510017152:0@lo:103: 00000100:00100000:2.0:1789181330.740671:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181330.741963:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1baba5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:880710ad-110c-42a4-a174-ab1b99a7ebeb+12:3303:x1876092510017024:12345-0@lo:103: Request processed in 2884us (3252us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181330.741976:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789181330.742005:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510017280 00000100:00100000:0.0:1789181330.742013:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510017280 00010000:00010000:0.0:1789181330.742039:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dc180030c00/0x8f4f7840b2e40e60 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f4f7840b2e40e59 expref: 12 pid: 5836 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181330.742056:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510017152 00000100:00100000:0.0:1789181330.742059:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510017152 00010000:00010000:0.0:1789181330.742070:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dc180031a00/0x8f4f7840b2e40e7c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f4f7840b2e40e75 expref: 13 pid: 5836 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181330.742084:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789181330.742092:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc188549180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:880710ad-110c-42a4-a174-ab1b99a7ebeb+13:3306:x1876092510017280:12345-0@lo:103: 00010000:00010000:0.0:1789181330.742118:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789181330.742401:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dc180030c00/0x8f4f7840b2e40e60 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f4f7840b2e40e59 expref: 13 pid: 5836 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181330.742416:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dc180030c00/0x8f4f7840b2e40e60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8f4f7840b2e40e59 expref: 13 pid: 5836 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181330.742432:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc180030c00/0x8f4f7840b2e40e60 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8f4f7840b2e40e59 expref: 13 pid: 5836 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181330.742446:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789181330.742566:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc188549180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:880710ad-110c-42a4-a174-ab1b99a7ebeb+12:3306:x1876092510017280:12345-0@lo:103: Request processed in 474us (2555us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181330.742574:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789181330.742590:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789181330.742596:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc188548700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:880710ad-110c-42a4-a174-ab1b99a7ebeb+11:3304:x1876092510017152:12345-0@lo:103: 00010000:00010000:0.0:1789181330.742604:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789181330.742609:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dc180031a00/0x8f4f7840b2e40e7c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f4f7840b2e40e75 expref: 11 pid: 5836 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181330.742619:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dc180031a00/0x8f4f7840b2e40e7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8f4f7840b2e40e75 expref: 11 pid: 5836 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181330.742629:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc180031a00/0x8f4f7840b2e40e7c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8f4f7840b2e40e75 expref: 11 pid: 5836 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181330.742639:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9dc1c2045c00/0x8f4f7840b2e40f47 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181330.742647:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc1c2045c00/0x8f4f7840b2e40f47 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181330.742669:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dc1c2045c00/0x8f4f7840b2e40f47 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181330.742676:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dc1c2045c00/0x8f4f7840b2e40f47 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181330.742684:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dc1c2045c00/0x8f4f7840b2e40f47 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181330.742884:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc188549880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:880710ad-110c-42a4-a174-ab1b99a7ebeb:3306:1876092510017280:0@lo:103: 00010000:00010000:0.0:1789181330.742933:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dc1c2045c00/0x8f4f7840b2e40f47 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181330.742940:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1c2045c00 already unused, calling callback (ffffffffc152f9b0) 00010000:00010000:0.0:1789181330.742944:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dc1c2045c00/0x8f4f7840b2e40f47 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181330.742952:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dc1c2045c00/0x8f4f7840b2e40f47 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181330.742970:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dc1c2045c00/0x8f4f7840b2e40f47 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181330.742981:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789181330.743016:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc188548700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:880710ad-110c-42a4-a174-ab1b99a7ebeb+10:3304:x1876092510017152:12345-0@lo:103: Request processed in 421us (2344us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181330.743023:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1789181330.743046:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181330.743063:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc188549f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:880710ad-110c-42a4-a174-ab1b99a7ebeb:3304:1876092510017152:0@lo:103: 00010000:00010000:3.0:1789181330.743111:0:5835:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9dc1c2045c00/0x8f4f7840b2e40f47 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181330.743121:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dc1c2045c00/0x8f4f7840b2e40f47 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181330.743127:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc1c2045c00/0x8f4f7840b2e40f47 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789181330.743141:0:5835:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1789181330.745243:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc188548380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:880710ad-110c-42a4-a174-ab1b99a7ebeb:3303:1876092510017024:0@lo:103: 00000100:00100000:3.0:1789181330.802781:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+9:6689:x1876092510016512:12345-0@lo:253: Request processed in 79199us (80610us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181330.802921:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789181330.803014:0:6689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc18854bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:6689:1876092510016512:0@lo:253: 10000000:01000000:2.0:1789181330.803032:0:6689:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789181330.803036:0:6689:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789181330.803037:0:6689:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789181330.803039:0:6689:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789181330.803041:0:6689:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1789181330.803042:0:6689:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789181330.803044:0:6689:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789181330.803045:0:6689:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789181330.803047:0:6689:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1789181330.803049:0:6689:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789181330.803050:0:6689:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789181330.803069:0:6689:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9dc189d1d800 from lustre-OST0000 10000000:01000000:2.0:1789181330.803095:0:6689:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1789181330.803099:0:6689:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789181330.803105:0:6689:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9dc18851cd40 local copy 10000000:01000000:2.0:1789181330.803124:0:6689:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789181330.803163:0:6689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc18151b400/0x8f4f7840b2e40f4e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181330.803174:0:6689:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.132@tcp lock: ffff9dc18151b400/0x8f4f7840b2e40f4e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181330.803184:0:6689:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.132@tcp lock: ffff9dc18151b400/0x8f4f7840b2e40f4e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181330.803202:0:6689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc18854bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:6689:1876092510017408:0@lo:101: 00000100:00100000:2.0:1789181330.803240:0:6689:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181330.803372:0:6689:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1aa457b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789181330.803587:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510017408 00000100:00100000:3.0:1789181330.803595:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510017408 00000100:00100000:3.0:1789181330.803732:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789181330.803743:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c273050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+9:6689:x1876092510017408:12345-0@lo:101: 00010000:00010000:3.0:1789181330.803754:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181330.803767:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc1c2175200/0x8f4f7840b2e40f55 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f4f7840b2e40f4e expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181330.803915:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc1c2175200/0x8f4f7840b2e40f55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f4f7840b2e40f4e expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181330.803929:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc1c2175200/0x8f4f7840b2e40f55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e40f4e expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181330.803952:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1c2175200, rc 0) 00000100:00100000:3.0:1789181330.804001:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c273050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+10:6689:x1876092510017408:12345-0@lo:101: Request processed in 260us (760us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181330.804008:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789181330.804082:0:6689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc18854bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:6689:1876092510017408:0@lo:101: 00010000:00010000:2.0:1789181330.804098:0:6689:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.132@tcp lock: ffff9dc18151b400/0x8f4f7840b2e40f4e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x8f4f7840b2e40f55 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181330.804108:0:6689:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.132@tcp lock: ffff9dc18151b400/0x8f4f7840b2e40f4e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x8f4f7840b2e40f55 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181330.804207:0:6689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc18854bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:6689:1876092510017536:0@lo:501: 00000100:00100000:2.0:1789181330.804249:0:6689:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181330.804534:0:6689:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1aa457b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789181330.804617:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510017536 00000100:00100000:1.0:1789181330.804622:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510017536 00000100:00100000:1.0:1789181330.804658:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789181330.804665:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+10:6689:x1876092510017536:12345-0@lo:501: 00000100:00100000:1.0:1789181330.804893:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+10:6689:x1876092510017536:12345-0@lo:501: Request processed in 227us (641us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789181330.804900:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789181330.805080:0:6689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc18854bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:6689:1876092510017536:0@lo:501: 10000000:01000000:2.0:1789181330.805095:0:6689:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.132@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789181330.805122:0:6689:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.132@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789181330.805128:0:6689:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc18151b400/0x8f4f7840b2e40f4e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x8f4f7840b2e40f55 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181330.805150:0:6689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc18151b400/0x8f4f7840b2e40f4e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x8f4f7840b2e40f55 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181330.805159:0:6689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.132@tcp lock: ffff9dc18151b400/0x8f4f7840b2e40f4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x8f4f7840b2e40f55 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181330.805183:0:6689:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789181330.805203:0:6689:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9dc189d1d800 10000000:01000000:2.0:1789181330.805208:0:6689:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789181330.805212:0:6689:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9dc18851cd40 10000000:01000000:2.0:1789181330.805215:0:6689:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1789181330.805218:0:6689:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9dc18851cd40 from 1 10000000:01000000:2.0:1789181330.805221:0:6689:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789181330.805242:0:6689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc18151a400/0x8f4f7840b2e40f5c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181330.805250:0:6689:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.132@tcp lock: ffff9dc18151a400/0x8f4f7840b2e40f5c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181330.805268:0:6689:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.132@tcp lock: ffff9dc18151a400/0x8f4f7840b2e40f5c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181330.805284:0:6689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc18854bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:6689:1876092510017664:0@lo:101: 00000100:00100000:2.0:1789181330.805348:0:6689:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181330.805363:0:6689:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1aa457c00 going to sleep for 11 seconds 00010000:00010000:1.0:1789181330.805598:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789181330.805606:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.132@tcp lock: ffff9dc18151b400/0x8f4f7840b2e40f4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x8f4f7840b2e40f55 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181330.805614:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc18151b400 already unused, calling callback (ffffffffc1b45c20) 10000000:00010000:1.0:1789181330.805617:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.132@tcp lock: ffff9dc18151b400/0x8f4f7840b2e40f4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x8f4f7840b2e40f55 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181330.805636:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.132@tcp lock: ffff9dc18151b400/0x8f4f7840b2e40f4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x8f4f7840b2e40f55 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789181330.805644:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.132@tcp lock: ffff9dc18151b400/0x8f4f7840b2e40f4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x8f4f7840b2e40f55 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789181330.805650:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789181330.805670:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.132@tcp lock: ffff9dc18151b400/0x8f4f7840b2e40f4e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x8f4f7840b2e40f55 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181330.805677:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789181330.805701:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.132@tcp lock: ffff9dc18151b400/0x8f4f7840b2e40f4e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x8f4f7840b2e40f55 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181330.805715:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.132@tcp lock: ffff9dc18151b400/0x8f4f7840b2e40f4e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x8f4f7840b2e40f55 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181330.805730:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181330.805732:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181330.805734:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181330.805745:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510017664 00000100:00100000:1.0:1789181330.805750:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510017664 00000100:00100000:1.0:1789181330.805773:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789181330.805780:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+10:6689:x1876092510017664:12345-0@lo:101: 00010000:00010000:1.0:1789181330.805800:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181330.805811:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc1c2044200/0x8f4f7840b2e40f63 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f4f7840b2e40f5c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181330.806000:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1baba5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:880710ad-110c-42a4-a174-ab1b99a7ebeb:3306:1876092510017792:0@lo:103: 00000100:00100000:2.0:1789181330.806035:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789181330.806119:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc1c2044200/0x8f4f7840b2e40f63 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f4f7840b2e40f5c expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181330.806130:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc1c2044200/0x8f4f7840b2e40f63 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e40f5c expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181330.806138:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1c2044200, rc 0) 00000100:00100000:1.0:1789181330.806192:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+11:6689:x1876092510017664:12345-0@lo:101: Request processed in 412us (860us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181330.806199:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789181330.806281:0:6689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc18854bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:6689:1876092510017664:0@lo:101: 00010000:00010000:2.0:1789181330.806317:0:6689:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.132@tcp lock: ffff9dc18151a400/0x8f4f7840b2e40f5c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e40f63 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181330.806326:0:6689:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.132@tcp lock: ffff9dc18151a400/0x8f4f7840b2e40f5c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f4f7840b2e40f63 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789181330.806373:0:6689:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.132@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789181330.806383:0:6689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc18151a400/0x8f4f7840b2e40f5c lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e40f63 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181330.806390:0:6689:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.132@tcp lock: ffff9dc18151a400/0x8f4f7840b2e40f5c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e40f63 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789181330.806397:0:6689:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789181330.806401:0:6689:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789181330.806406:0:6689:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1789181330.806408:0:6689:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789181330.806423:0:6689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc18151b000/0x8f4f7840b2e40f6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181330.806429:0:6689:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.132@tcp lock: ffff9dc18151b000/0x8f4f7840b2e40f6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181330.806436:0:6689:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.132@tcp lock: ffff9dc18151b000/0x8f4f7840b2e40f6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181330.806447:0:6689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc18854bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:6689:1876092510017920:0@lo:101: 00000100:00100000:2.0:1789181330.806473:0:6689:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181330.806485:0:6689:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1aa457c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789181330.806686:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510017920 00000100:00100000:1.0:1789181330.806691:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510017920 00000100:00100000:1.0:1789181330.806713:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789181330.806719:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+11:6689:x1876092510017920:12345-0@lo:101: 00010000:00010000:1.0:1789181330.806734:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181330.806744:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc1c2044e00/0x8f4f7840b2e40f71 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f4f7840b2e40f6a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181330.806759:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc1c2044e00/0x8f4f7840b2e40f71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f4f7840b2e40f6a expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181330.806766:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc1c2044e00/0x8f4f7840b2e40f71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e40f6a expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181330.806773:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1c2044e00, rc 0) 00000100:00100000:1.0:1789181330.807442:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+12:6689:x1876092510017920:12345-0@lo:101: Request processed in 99us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181330.807450:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789181330.807571:0:6689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc18854bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:6689:1876092510017920:0@lo:101: 00010000:00010000:2.0:1789181330.807596:0:6689:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.132@tcp lock: ffff9dc18151b000/0x8f4f7840b2e40f6a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e40f71 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181330.807605:0:6689:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.132@tcp lock: ffff9dc18151b000/0x8f4f7840b2e40f6a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f4f7840b2e40f71 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181330.807716:0:6689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc18854bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:6689:1876092510018048:0@lo:501: 00000100:00100000:2.0:1789181330.807751:0:6689:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181330.807784:0:6689:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1aa457c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789181330.807974:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510018048 00000100:00100000:1.0:1789181330.807979:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510018048 00000100:00100000:1.0:1789181330.808002:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789181330.808009:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c270050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+12:6689:x1876092510018048:12345-0@lo:501: 00000100:00100000:1.0:1789181330.808227:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c270050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+12:6689:x1876092510018048:12345-0@lo:501: Request processed in 218us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181330.808234:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789181330.808436:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510017792 00000100:00100000:1.0:1789181330.808441:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510017792 00000100:00100000:1.0:1789181330.808477:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789181330.808484:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc188549500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:880710ad-110c-42a4-a174-ab1b99a7ebeb+12:3306:x1876092510017792:12345-0@lo:103: 00010000:00010000:1.0:1789181330.808493:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789181330.808509:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc1c2175200/0x8f4f7840b2e40f55 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8f4f7840b2e40f4e expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181330.808536:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789181330.808572:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc188549500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:880710ad-110c-42a4-a174-ab1b99a7ebeb+11:3306:x1876092510017792:12345-0@lo:103: Request processed in 88us (2536us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181330.808579:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789181330.808738:0:6689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc18854bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:6689:1876092510018048:0@lo:501: 00000100:00100000:2.0:1789181330.808771:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1baba5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:880710ad-110c-42a4-a174-ab1b99a7ebeb:3306:1876092510017792:0@lo:103: 00000100:00100000:2.0:1789181330.808935:0:6689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc18854bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:6689:1876092510018176:0@lo:503: 00000100:00100000:2.0:1789181330.808976:0:6689:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181330.809033:0:6689:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1aa457c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789181330.809401:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510018176 00000100:00100000:3.0:1789181330.809407:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510018176 00000100:00100000:1.0:1789181330.809615:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789181330.809625:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c271c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+11:6689:x1876092510018176:12345-0@lo:503: 00000100:00100000:2.0:1789181330.809924:0:6689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc18854bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:6689:1876092510018176:0@lo:503: 00000040:00080000:2.0:1789181330.810192:0:6689:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789181330.810252:0:6689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc18854bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:6689:1876092510018304:0@lo:502: 00000100:00100000:2.0:1789181330.810964:0:6689:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181330.811003:0:6689:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1aa457c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789181330.811053:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510018304 00000100:00100000:3.0:1789181330.811059:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510018304 00000100:00100000:3.0:1789181330.811096:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789181330.811104:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c270450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+12:6689:x1876092510018304:12345-0@lo:502: 00000100:00100000:3.0:1789181330.811282:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c270450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+12:6689:x1876092510018304:12345-0@lo:502: Request processed in 179us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181330.811289:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789181330.811457:0:6689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc18854bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:6689:1876092510018304:0@lo:502: 00000040:00080000:2.0:1789181330.812138:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1789181330.812196:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1789181330.812225:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1789181330.812277:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000100:00100000:1.0:1789181330.812720:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c271c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+11:6689:x1876092510018176:12345-0@lo:503: Request processed in 3094us (3740us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181330.812730:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000040:00080000:2.0:1789181330.812959:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1789181330.812999:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1789181330.813048:0:6689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc18854bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:6689:1876092510018432:0@lo:502: 00000100:00100000:2.0:1789181330.813099:0:6689:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181330.813182:0:6689:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1aa457c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789181330.813225:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510018432 00000100:00100000:3.0:1789181330.813232:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510018432 00000100:00100000:3.0:1789181330.813496:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789181330.813507:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c272c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+11:6689:x1876092510018432:12345-0@lo:502: 00000100:00100000:3.0:1789181330.813708:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c272c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+11:6689:x1876092510018432:12345-0@lo:502: Request processed in 204us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181330.813714:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789181330.813810:0:6689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc18854bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:6689:1876092510018432:0@lo:502: 00000040:00080000:2.0:1789181330.813923:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1789181330.813934:0:6689:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:2.0:1789181330.814661:0:6708:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789181330.814669:0:6708:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1789181330.814676:0:6708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789181330.814679:0:6708:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1789181330.814686:0:6708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789181330.814702:0:6708:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9dc1babc99c0) 00000020:00000080:2.0:1789181330.814722:0:6708:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789181330.814726:0:6708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789181330.814806:0:6708:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dc189d1d800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1789181330.814813:0:6708:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789181330.814830:0:6708:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x8f4f7840b2e40f7f 00010000:00010000:2.0:1789181330.822208:0:6708:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:3.0:1789181330.823151:0:6708:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1789181330.826204:0:6708:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1789181330.827970:0:6708:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1789181330.836243:0:6708:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1789181330.837759:0:6708:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1789181330.840232:0:6708:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1789181330.840244:0:6708:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789181330.840251:0:6708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789181330.840253:0:6708:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1789181330.840256:0:6708:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789181330.840271:0:6708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789181330.840277:0:6708:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789181330.840281:0:6708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789181330.840283:0:6708:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789181330.840531:0:6708:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789181330.840536:0:6708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789181330.840538:0:6708:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789181330.840541:0:6708:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1789181330.840698:0:6689:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:2.0:1789181330.840722:0:6689:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.132@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1789181330.840746:0:6689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc18151b000/0x8f4f7840b2e40f6a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e40f71 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181330.840758:0:6689:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.132@tcp lock: ffff9dc18151b000/0x8f4f7840b2e40f6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e40f71 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789181330.840778:0:6689:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9dc189d1d800 from 1 10000000:01000000:2.0:1789181330.840781:0:6689:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789181330.840834:0:6689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc18151ae00/0x8f4f7840b2e40f86 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181330.840843:0:6689:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.132@tcp lock: ffff9dc18151ae00/0x8f4f7840b2e40f86 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181330.840855:0:6689:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.132@tcp lock: ffff9dc18151ae00/0x8f4f7840b2e40f86 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181330.840878:0:6689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc18854bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:6689:1876092510018560:0@lo:101: 00000100:00100000:2.0:1789181330.840942:0:6689:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181330.840983:0:6689:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc186df8000 going to sleep for 11 seconds 00000100:00100000:0.0:1789181330.841270:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510018560 00000100:00100000:0.0:1789181330.841310:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510018560 00000100:00100000:0.0:1789181330.841382:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789181330.841392:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+11:6689:x1876092510018560:12345-0@lo:101: 00010000:00010000:0.0:1789181330.841404:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181330.841416:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc180031a00/0x8f4f7840b2e40f8d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f4f7840b2e40f86 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181330.841438:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc180031a00/0x8f4f7840b2e40f8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f4f7840b2e40f86 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181330.841448:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc180031a00/0x8f4f7840b2e40f8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e40f86 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181330.841455:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc180031a00, rc 0) 00000100:00100000:0.0:1789181330.841496:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+12:6689:x1876092510018560:12345-0@lo:101: Request processed in 107us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181330.841502:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789181330.841669:0:6689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc18854bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:6689:1876092510018560:0@lo:101: 00010000:00010000:2.0:1789181330.841685:0:6689:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.132@tcp lock: ffff9dc18151ae00/0x8f4f7840b2e40f86 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e40f8d expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181330.841694:0:6689:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.132@tcp lock: ffff9dc18151ae00/0x8f4f7840b2e40f86 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f4f7840b2e40f8d expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181330.841799:0:6689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc18854bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:6689:1876092510018688:0@lo:501: 00000100:00100000:2.0:1789181330.841837:0:6689:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181330.841860:0:6689:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc186df8000 going to sleep for 11 seconds 00000100:00100000:3.0:1789181330.842153:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510018688 00000100:00100000:3.0:1789181330.842158:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510018688 00000100:00100000:3.0:1789181330.842195:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789181330.842203:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+12:6689:x1876092510018688:12345-0@lo:501: 00000100:00100000:3.0:1789181330.842479:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+12:6689:x1876092510018688:12345-0@lo:501: Request processed in 276us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181330.842487:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789181330.842950:0:6689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc18854bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:6689:1876092510018688:0@lo:501: 00000100:00100000:2.0:1789181330.842987:0:6689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc18854bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:6689:1876092510018816:0@lo:503: 00000100:00100000:2.0:1789181330.843039:0:6689:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181330.843074:0:6689:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc186df8000 going to sleep for 11 seconds 00000100:00100000:3.0:1789181330.843114:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510018816 00000100:00100000:3.0:1789181330.843119:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510018816 00000100:00100000:3.0:1789181330.843150:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789181330.843157:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+12:6689:x1876092510018816:12345-0@lo:503: 00000100:00100000:3.0:1789181330.843458:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+12:6689:x1876092510018816:12345-0@lo:503: Request processed in 301us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181330.843465:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789181330.843679:0:6689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc18854bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:6689:1876092510018816:0@lo:503: 00000040:00080000:2.0:1789181330.844160:0:6689:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789181330.844232:0:6689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc18854bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:6689:1876092510018944:0@lo:502: 00000100:00100000:2.0:1789181330.844286:0:6689:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181330.844465:0:6689:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc189ab7a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789181330.844532:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510018944 00000100:00100000:3.0:1789181330.844537:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510018944 00000100:00100000:3.0:1789181330.844575:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789181330.844584:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+12:6689:x1876092510018944:12345-0@lo:502: 00000100:00100000:3.0:1789181330.844768:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+12:6689:x1876092510018944:12345-0@lo:502: Request processed in 185us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181330.844775:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789181330.845081:0:6689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc18854bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:6689:1876092510018944:0@lo:502: 00000040:00080000:2.0:1789181330.845592:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1789181330.845713:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1789181330.845741:0:6689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc18854bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:6689:1876092510019072:0@lo:502: 00000100:00100000:2.0:1789181330.845780:0:6689:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181330.845957:0:6689:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc189ab7a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789181330.848290:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510019072 00000100:00100000:3.0:1789181330.848310:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510019072 00000100:00100000:3.0:1789181330.848380:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789181330.848392:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+12:6689:x1876092510019072:12345-0@lo:502: 00000100:00100000:3.0:1789181330.849002:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+12:6689:x1876092510019072:12345-0@lo:502: Request processed in 610us (3218us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181330.849021:0:6689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc18854bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:6689:1876092510019072:0@lo:502: 00000100:00100000:3.0:1789181330.849142:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000040:00080000:2.0:1789181330.849159:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1789181330.849173:0:6689:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1789181330.851927:0:6712:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789181330.851940:0:6712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789181330.851942:0:6712:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789181330.851949:0:6712:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dc189d1d800 00000020:00000080:1.0:1789181330.851952:0:6712:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789181330.851972:0:6712:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789181330.851976:0:6712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789181330.851978:0:6712:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1789181330.851981:0:6712:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1789181330.852180:0:6689:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1789181330.852204:0:6689:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789181330.852227:0:6689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc18151ae00/0x8f4f7840b2e40f86 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e40f8d expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181330.852239:0:6689:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.132@tcp lock: ffff9dc18151ae00/0x8f4f7840b2e40f86 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e40f8d expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789181330.852292:0:6689:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789181330.852500:0:6689:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9dc189d1d800 10000000:01000000:2.0:1789181330.852504:0:6689:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9dc189d1d800 10000000:01000000:2.0:1789181330.852525:0:6689:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789181330.852532:0:6689:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9dc189d1d800 from 1 10000000:01000000:2.0:1789181330.852534:0:6689:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789181330.852569:0:6689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc18151be00/0x8f4f7840b2e40f94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181330.852578:0:6689:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.132@tcp lock: ffff9dc18151be00/0x8f4f7840b2e40f94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181330.852590:0:6689:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.132@tcp lock: ffff9dc18151be00/0x8f4f7840b2e40f94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181330.852610:0:6689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc18854bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:6689:1876092510019200:0@lo:101: 00000100:00100000:2.0:1789181330.852739:0:6689:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181330.852985:0:6689:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc189ab7180 going to sleep for 11 seconds 00000100:00100000:0.0:1789181330.855545:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510019200 00000100:00100000:0.0:1789181330.855559:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510019200 00000100:00100000:0.0:1789181330.855613:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789181330.855622:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c371c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+12:6689:x1876092510019200:12345-0@lo:101: 00010000:00010000:0.0:1789181330.855761:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181330.855779:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc180030c00/0x8f4f7840b2e40f9b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f4f7840b2e40f94 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181330.855822:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc180030c00/0x8f4f7840b2e40f9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f4f7840b2e40f94 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181330.855834:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc180030c00/0x8f4f7840b2e40f9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e40f94 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181330.855857:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc180030c00, rc 0) 00000100:00100000:0.0:1789181330.855925:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c371c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+13:6689:x1876092510019200:12345-0@lo:101: Request processed in 305us (3186us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181330.855932:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789181330.856060:0:6689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc18854bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:6689:1876092510019200:0@lo:101: 00010000:00010000:2.0:1789181330.856077:0:6689:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.132@tcp lock: ffff9dc18151be00/0x8f4f7840b2e40f94 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e40f9b expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181330.856086:0:6689:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.132@tcp lock: ffff9dc18151be00/0x8f4f7840b2e40f94 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f4f7840b2e40f9b expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181330.856186:0:6689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc18854bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:6689:1876092510019328:0@lo:501: 00000100:00100000:2.0:1789181330.856215:0:6689:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181330.856248:0:6689:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc189ab7180 going to sleep for 11 seconds 00000100:00100000:0.0:1789181330.856311:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510019328 00000100:00100000:0.0:1789181330.856315:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510019328 00000100:00100000:0.0:1789181330.856408:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789181330.856416:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c370450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+13:6689:x1876092510019328:12345-0@lo:501: 00000100:00100000:0.0:1789181330.856642:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c370450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+13:6689:x1876092510019328:12345-0@lo:501: Request processed in 226us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181330.856649:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789181330.856737:0:6689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc18854bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:6689:1876092510019328:0@lo:501: 00000100:00100000:3.0:1789181330.856768:0:6689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6af1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:6689:1876092510019456:0@lo:503: 00000100:00100000:3.0:1789181330.856807:0:6689:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181330.858274:0:6689:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc189a44c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789181330.858524:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510019456 00000100:00100000:2.0:1789181330.858532:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510019456 00000100:00100000:2.0:1789181330.858573:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789181330.858581:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c372c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+13:6689:x1876092510019456:12345-0@lo:503: 00000100:00100000:2.0:1789181330.858811:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c372c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+13:6689:x1876092510019456:12345-0@lo:503: Request processed in 229us (2001us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181330.858827:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789181330.858911:0:6689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6af1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:6689:1876092510019456:0@lo:503: 00000040:00080000:3.0:1789181330.859166:0:6689:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789181330.859227:0:6689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6af1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:6689:1876092510019584:0@lo:502: 00000100:00100000:3.0:1789181330.859284:0:6689:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181330.859320:0:6689:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc189a44c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789181330.859991:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510019584 00000100:00100000:2.0:1789181330.859998:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510019584 00000100:00100000:2.0:1789181330.860026:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789181330.860033:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c370c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+13:6689:x1876092510019584:12345-0@lo:502: 00000100:00100000:2.0:1789181330.860217:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c370c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+13:6689:x1876092510019584:12345-0@lo:502: Request processed in 184us (932us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181330.860224:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789181330.860321:0:6689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6af1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:6689:1876092510019584:0@lo:502: 00000040:00080000:3.0:1789181330.860604:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1789181330.860986:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1789181330.861019:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1789181330.861081:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1789181330.861115:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1789181330.861157:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1789181330.861188:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1789181330.861216:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1789181330.861490:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1789181330.861534:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1789181330.861569:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1789181330.861710:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1789181330.861755:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1789181330.861920:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1789181330.861976:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1789181330.862016:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1789181330.862053:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1789181330.862116:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1789181330.862159:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1789181330.862195:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1789181330.862241:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1789181330.862292:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1789181330.862773:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1789181330.862962:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1789181330.863019:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1789181330.863057:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1789181330.863111:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1789181330.863150:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:3.0:1789181330.863196:0:6689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6af1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:6689:1876092510019712:0@lo:502: 00000100:00100000:3.0:1789181330.863280:0:6689:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181330.863558:0:6689:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc189a44c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789181330.863719:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510019712 00000100:00100000:1.0:1789181330.863727:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510019712 00000100:00100000:2.0:1789181330.863799:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789181330.863810:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c371450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+13:6689:x1876092510019712:12345-0@lo:502: 00000100:00100000:2.0:1789181330.864044:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c371450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+13:6689:x1876092510019712:12345-0@lo:502: Request processed in 235us (763us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181330.864053:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789181330.864205:0:6689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6af1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:6689:1876092510019712:0@lo:502: 00000040:00080000:3.0:1789181330.864810:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1789181330.864890:0:6689:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1789181330.866157:0:6713:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1789181330.866174:0:6713:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9dc1898bb380) 00000020:00000080:3.0:1789181330.866196:0:6713:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:3.0:1789181330.866273:0:6713:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dc189d1d800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789181330.866278:0:6713:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dc189d1d800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789181330.866281:0:6713:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dc189d1d800 3 00010000:00080000:3.0:1789181330.866538:0:6713:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dc081294800@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.132@tcp at head 00010000:00010000:3.0:1789181330.869179:0:6713:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:2.0:1789181330.871318:0:6713:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1789181330.871389:0:6713:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789181330.871402:0:6713:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x8f4f7840b2e40fa9 00000100:00080000:2.0:1789181330.871412:0:6713:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789181330.871424:0:6713:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9dc081294800 using connection 192.168.204.132@tcp/0@lo 00000100:00100000:2.0:1789181330.871459:0:6713:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc18854a680 x1876092510019840/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789181330.871481:0:6713:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789181330.871738:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc18854a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3302:1876092510019840:0@lo:38: 00000100:00100000:3.0:1789181330.871802:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181330.871960:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789181330.871969:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc18854b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876092510019968:0@lo:400: 00000100:00100000:0.0:1789181330.871997:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181330.872029:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510019840 00000100:00100000:0.0:1789181330.872035:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510019840 00000100:00100000:0.0:1789181330.872058:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510019968 00000100:00100000:0.0:1789181330.872060:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510019968 00000100:00100000:0.0:1789181330.872081:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789181330.872089:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6b53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876092510019968:12345-0@lo:400: 00000100:00100000:0.0:1789181330.872132:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6b53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876092510019968:12345-0@lo:400: Request processed in 44us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181330.872140:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789181330.872154:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789181330.872158:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6af1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3302:x1876092510019840:12345-0@lo:38: 00010000:00080000:0.0:1789181330.872175:0:5842:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 223 last 0 00000020:00000080:0.0:1789181330.872210:0:5842:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x8f4f7840b2e40fb0 00000004:00100000:0.0:1789181330.872223:0:5842:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789181330.872249:0:5842:0:(import.c:65:import_set_state_nolock()) ffff9dc1c10a7000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789181330.872302:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6af1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876092510019840:12345-0@lo:38: Request processed in 143us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181330.872309:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789181330.872365:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9dc18854b480 x1876092510019968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181346 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181330.872378:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc18854b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876092510019968:0@lo:400: 00010000:00080000:3.0:1789181330.872462:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9dc18854a680 x1876092510019840/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789181340 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181330.872471:0:3302:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789181330.872476:0:3302:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1789181330.872482:0:3302:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789181330.872486:0:3302:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789181330.872489:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9dc081294800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789181330.872494:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc18854a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3302:1876092510019840:0@lo:38: 00000040:00080000:1.0:1789181330.875571:0:6713:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:2.0:1789181330.875939:0:6689:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1789181330.875962:0:6689:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789181330.875982:0:6689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc18151be00/0x8f4f7840b2e40f94 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e40f9b expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181330.876002:0:6689:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.132@tcp lock: ffff9dc18151be00/0x8f4f7840b2e40f94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e40f9b expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789181330.876041:0:6689:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789181330.876043:0:6689:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789181330.876045:0:6689:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789181330.876046:0:6689:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789181330.876048:0:6689:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789181330.876049:0:6689:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789181330.876051:0:6689:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789181330.876053:0:6689:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789181330.876054:0:6689:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789181330.876055:0:6689:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789181330.876056:0:6689:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789181330.876060:0:6689:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1789181330.876062:0:6689:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789181330.876063:0:6689:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789181330.876064:0:6689:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789181330.876066:0:6689:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789181330.876067:0:6689:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789181330.876068:0:6689:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789181330.876069:0:6689:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789181330.876070:0:6689:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789181330.876071:0:6689:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789181330.876072:0:6689:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789181330.876073:0:6689:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789181330.876096:0:6689:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789181330.876111:0:6689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc188548000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:6689:1876092510020096:0@lo:253: 00000100:00100000:2.0:1789181330.876174:0:6689:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181330.876208:0:6689:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1aa457900 going to sleep for 11 seconds 00000100:00100000:2.0:1789181330.876229:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510020096 00000100:00100000:2.0:1789181330.876236:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510020096 00000100:00100000:2.0:1789181330.876290:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789181330.877490:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c371050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+13:6689:x1876092510020096:12345-0@lo:253: 20000000:01000000:2.0:1789181330.877544:0:5836:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1789181330.877559:0:5836:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789181330.912136:0:5836:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789181330.912177:0:5836:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1789181330.912895:0:5858:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789181330.912902:0:5858:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789181330.912924:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dc1c2175600/0x8f4f7840b2e40fb7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181330.912943:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dc180031600/0x8f4f7840b2e40f16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e40f0f expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181330.912952:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9dc1c2175600/0x8f4f7840b2e40fb7 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181330.912989:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dc180031600/0x8f4f7840b2e40f16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8f4f7840b2e40f0f expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181330.913002:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dc180031600/0x8f4f7840b2e40f16 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8f4f7840b2e40f0f expref: 13 pid: 5837 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181330.913017:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6af2680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5858:1876092510020224:0@lo:104: 00000100:00100000:3.0:1789181330.913073:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181330.913143:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc189a44780 going to sleep for 11 seconds 00000100:00100000:0.0:1789181330.913198:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510020224 00000100:00100000:0.0:1789181330.913206:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510020224 00000100:00100000:0.0:1789181330.913248:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789181330.913266:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6af3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:880710ad-110c-42a4-a174-ab1b99a7ebeb+3:5858:x1876092510020224:12345-0@lo:104: 00010000:00010000:0.0:1789181330.913279:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.132@tcp lock: ffff9dc18151a800/0x8f4f7840b2e40f0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f4f7840b2e40f16 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181330.913459:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789181330.913466:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6af3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:880710ad-110c-42a4-a174-ab1b99a7ebeb+3:5858:x1876092510020224:12345-0@lo:104: Request processed in 211us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181330.913473:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1789181330.913501:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789181330.913507:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.132@tcp lock: ffff9dc18151a800/0x8f4f7840b2e40f0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f4f7840b2e40f16 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181330.913514:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc18151a800 already unused, calling callback (ffffffffc1b45c20) 10000000:00010000:0.0:1789181330.913518:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.132@tcp lock: ffff9dc18151a800/0x8f4f7840b2e40f0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8f4f7840b2e40f16 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181330.913533:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.132@tcp lock: ffff9dc18151a800/0x8f4f7840b2e40f0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8f4f7840b2e40f16 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789181330.913540:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.132@tcp lock: ffff9dc18151a800/0x8f4f7840b2e40f0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8f4f7840b2e40f16 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789181330.913545:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789181330.913573:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.132@tcp lock: ffff9dc18151a800/0x8f4f7840b2e40f0f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e40f16 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181330.913579:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789181330.913596:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.132@tcp lock: ffff9dc18151a800/0x8f4f7840b2e40f0f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e40f16 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181330.913603:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.132@tcp lock: ffff9dc18151a800/0x8f4f7840b2e40f0f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e40f16 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181330.913619:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181330.913621:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181330.913623:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181330.913640:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6b50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:880710ad-110c-42a4-a174-ab1b99a7ebeb:3304:1876092510020352:0@lo:103: 00000100:00100000:0.0:1789181330.913671:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181330.913711:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510020352 00000100:00100000:0.0:1789181330.913716:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510020352 00010000:00010000:0.0:1789181330.913730:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dc180031600/0x8f4f7840b2e40f16 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f4f7840b2e40f0f expref: 14 pid: 5837 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181330.913748:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789181330.913754:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1960f1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:880710ad-110c-42a4-a174-ab1b99a7ebeb+14:3304:x1876092510020352:12345-0@lo:103: 00010000:00010000:0.0:1789181330.913772:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789181330.913777:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dc180031600/0x8f4f7840b2e40f16 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f4f7840b2e40f0f expref: 14 pid: 5837 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181330.913786:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dc180031600/0x8f4f7840b2e40f16 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8f4f7840b2e40f0f expref: 14 pid: 5837 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181330.913800:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9dc1c2175600/0x8f4f7840b2e40fb7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181330.913810:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc1c2175600/0x8f4f7840b2e40fb7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181330.913977:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc180031600/0x8f4f7840b2e40f16 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8f4f7840b2e40f0f expref: 14 pid: 5837 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181330.913988:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6af2680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5858:1876092510020224:0@lo:104: 00010000:00010000:2.0:1789181330.914706:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9dc1c2175600/0x8f4f7840b2e40fb7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789181330.914762:0:5829:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001861554s 00010000:00010000:0.0:1789181330.914769:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dc1c2175600/0x8f4f7840b2e40fb7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181330.914778:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dc1c2175600/0x8f4f7840b2e40fb7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181330.914785:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dc1c2175600/0x8f4f7840b2e40fb7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181330.914792:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dc1c2175600/0x8f4f7840b2e40fb7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181330.914797:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1c2175600 already unused, calling callback (ffffffffc152f9b0) 00010000:00010000:0.0:1789181330.914801:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dc1c2175600/0x8f4f7840b2e40fb7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181330.914808:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dc1c2175600/0x8f4f7840b2e40fb7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181330.914851:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dc1c2175600/0x8f4f7840b2e40fb7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181330.914862:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789181330.914908:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1960f1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:880710ad-110c-42a4-a174-ab1b99a7ebeb+13:3304:x1876092510020352:12345-0@lo:103: Request processed in 1153us (1235us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181330.914916:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789181330.914973:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6b50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:880710ad-110c-42a4-a174-ab1b99a7ebeb:3304:1876092510020352:0@lo:103: 00010000:00010000:2.0:1789181330.915076:0:5858:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9dc1c2175600/0x8f4f7840b2e40fb7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181330.915085:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dc1c2175600/0x8f4f7840b2e40fb7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181330.915091:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc1c2175600/0x8f4f7840b2e40fb7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181330.924800:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c371050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+12:6689:x1876092510020096:12345-0@lo:253: Request processed in 47309us (48616us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181330.924822:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789181330.924973:0:6689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc188548000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:6689:1876092510020096:0@lo:253: 10000000:01000000:3.0:1789181330.924987:0:6689:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1789181330.924990:0:6689:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789181330.924992:0:6689:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789181330.924994:0:6689:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789181330.924995:0:6689:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789181330.924996:0:6689:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789181330.924997:0:6689:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789181330.924999:0:6689:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789181330.925001:0:6689:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789181330.925002:0:6689:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789181330.925003:0:6689:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789181330.925004:0:6689:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789181330.925017:0:6689:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789181330.930100:0:6689:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1789181330.930510:0:6689:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789181330.930746:0:6689:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1789181330.931005:0:6689:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1789181330.931196:0:6689:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1789181330.931740:0:6689:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1789181330.934022:0:6689:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:1.0:1789181331.019438:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1789181331.136623:0:6689:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1789181331.136630:0:6689:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1789181331.136661:0:6689:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789181331.136716:0:6689:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.132@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789181331.136731:0:6689:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1789181331.136769:0:6689:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1789181332.030572:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181333.058963:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181334.079290:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789181334.079954:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789181334.079960:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9dc1add60800 from 21 10000000:01000000:1.0:1789181334.079965:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789181334.080013:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc1c2044000/0x8f4f7840b2e40fbe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181334.080025:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.132@tcp lock: ffff9dc1c2044000/0x8f4f7840b2e40fbe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181334.080045:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.132@tcp lock: ffff9dc1c2044000/0x8f4f7840b2e40fbe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181334.080070:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1baba7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510020480:0@lo:101: 00000100:00100000:1.0:1789181334.080133:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181334.080191:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc189de5900 going to sleep for 11 seconds 00000100:00100000:2.0:1789181334.080366:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510020480 00000100:00100000:2.0:1789181334.080373:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510020480 00000100:00100000:2.0:1789181334.080426:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789181334.080435:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c371850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+12:5840:x1876092510020480:12345-0@lo:101: 00010000:00010000:2.0:1789181334.080449:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181334.080463:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc18151a800/0x8f4f7840b2e40fc5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f4f7840b2e40fbe expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181334.080485:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc18151a800/0x8f4f7840b2e40fc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f4f7840b2e40fbe expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181334.080495:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc18151a800/0x8f4f7840b2e40fc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e40fbe expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181334.080504:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc18151a800, rc 0) 00000100:00100000:2.0:1789181334.080552:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c371850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+13:5840:x1876092510020480:12345-0@lo:101: Request processed in 118us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181334.080559:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789181334.080647:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1baba7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510020480:0@lo:101: 00010000:00010000:0.0:1789181334.080662:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.132@tcp lock: ffff9dc1c2044000/0x8f4f7840b2e40fbe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e40fc5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181334.080671:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.132@tcp lock: ffff9dc1c2044000/0x8f4f7840b2e40fbe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f4f7840b2e40fc5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181334.080720:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6b50380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510020608:0@lo:501: 00000100:00100000:0.0:1789181334.080746:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181334.080776:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc189a44840 going to sleep for 11 seconds 00000100:00100000:1.0:1789181334.080830:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510020608 00000100:00100000:1.0:1789181334.080834:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510020608 00000100:00100000:1.0:1789181334.080865:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789181334.080944:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c372450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+13:5840:x1876092510020608:12345-0@lo:501: 00000100:00100000:1.0:1789181334.081285:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c372450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+13:5840:x1876092510020608:12345-0@lo:501: Request processed in 413us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181334.081293:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789181334.084854:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6b50380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510020608:0@lo:501: 00000100:00100000:3.0:1789181334.084917:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6af0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510020736:0@lo:503: 00000100:00100000:3.0:1789181334.084997:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181334.085052:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1c03e7d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789181334.085276:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510020736 00000100:00100000:1.0:1789181334.085283:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510020736 00000100:00100000:1.0:1789181334.085359:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789181334.085368:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c373450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+13:5840:x1876092510020736:12345-0@lo:503: 00000100:00100000:1.0:1789181334.085717:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c373450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+13:5840:x1876092510020736:12345-0@lo:503: Request processed in 349us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181334.085724:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789181334.086269:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6af0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510020736:0@lo:503: 00000100:00100000:3.0:1789181334.087560:0:6882:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6af0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:880710ad-110c-42a4-a174-ab1b99a7ebeb:6882:1876092510020864:0@lo:502: 00000100:00100000:3.0:1789181334.087622:0:6882:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181334.087661:0:6882:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1c03e7c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789181334.088009:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510020864 00000100:00100000:2.0:1789181334.088017:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510020864 00000100:00100000:2.0:1789181334.088064:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789181334.088073:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c373c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+13:6882:x1876092510020864:12345-0@lo:502: 00000100:00100000:2.0:1789181334.088422:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c373c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+13:6882:x1876092510020864:12345-0@lo:502: Request processed in 349us (798us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181334.088430:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789181334.088471:0:6882:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6af0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:880710ad-110c-42a4-a174-ab1b99a7ebeb:6882:1876092510020864:0@lo:502: 00000100:00100000:2.0:1789181334.088603:0:6882:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc18854aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:880710ad-110c-42a4-a174-ab1b99a7ebeb:6882:1876092510020992:0@lo:502: 00000100:00100000:2.0:1789181334.088647:0:6882:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181334.088720:0:6882:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc081837540 going to sleep for 11 seconds 00000100:00100000:0.0:1789181334.091989:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510020992 00000100:00100000:0.0:1789181334.092005:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510020992 00000100:00100000:1.0:1789181334.092214:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789181334.092225:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c373850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+13:6882:x1876092510020992:12345-0@lo:502: 00000100:00100000:1.0:1789181334.092555:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c373850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+13:6882:x1876092510020992:12345-0@lo:502: Request processed in 331us (3906us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181334.092564:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789181334.092691:0:6882:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc18854aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:880710ad-110c-42a4-a174-ab1b99a7ebeb:6882:1876092510020992:0@lo:502: 00000040:00080000:0.0:1789181334.092730:0:6882:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1789181334.092979:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1789181334.092998:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789181334.093009:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc1c2044000/0x8f4f7840b2e40fbe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e40fc5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181334.093022:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.132@tcp lock: ffff9dc1c2044000/0x8f4f7840b2e40fbe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e40fc5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789181334.093038:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789181334.093041:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9dc1add60800 from 4 10000000:01000000:3.0:1789181334.093043:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789181334.093075:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc1c2175800/0x8f4f7840b2e40fcc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181334.093083:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.132@tcp lock: ffff9dc1c2175800/0x8f4f7840b2e40fcc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181334.093092:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.132@tcp lock: ffff9dc1c2175800/0x8f4f7840b2e40fcc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181334.093109:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6af0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510021120:0@lo:101: 00000100:00100000:3.0:1789181334.093141:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181334.098000:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1c03e7c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789181334.099484:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510021120 00000100:00100000:2.0:1789181334.099498:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510021120 00000100:00100000:2.0:1789181334.099551:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789181334.099561:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c373050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+13:5840:x1876092510021120:12345-0@lo:101: 00010000:00010000:2.0:1789181334.099578:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181334.099598:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc18151b400/0x8f4f7840b2e40fd3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f4f7840b2e40fcc expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181334.099623:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc18151b400/0x8f4f7840b2e40fd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f4f7840b2e40fcc expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181334.099635:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc18151b400/0x8f4f7840b2e40fd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e40fcc expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181334.099643:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc18151b400, rc 0) 00000100:00100000:2.0:1789181334.099720:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c373050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+14:5840:x1876092510021120:12345-0@lo:101: Request processed in 161us (6578us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181334.099728:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789181334.099789:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6af0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510021120:0@lo:101: 00010000:00010000:2.0:1789181334.099808:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.132@tcp lock: ffff9dc1c2175800/0x8f4f7840b2e40fcc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e40fd3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181334.099817:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.132@tcp lock: ffff9dc1c2175800/0x8f4f7840b2e40fcc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f4f7840b2e40fd3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181334.100184:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc18854b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510021248:0@lo:256: 00000100:00100000:2.0:1789181334.100241:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181334.100277:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc081837cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789181334.100356:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510021248 00000100:00100000:0.0:1789181334.100361:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510021248 00000100:00100000:0.0:1789181334.100389:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789181334.100396:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c370850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+14:5840:x1876092510021248:12345-0@lo:256: 20000000:01000000:0.0:1789181334.100410:0:5836:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789181334.100426:0:5836:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789181334.100429:0:5836:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1789181334.100517:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c370850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+14:5840:x1876092510021248:12345-0@lo:256: Request processed in 121us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181334.100524:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789181334.100531:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc18854b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510021248:0@lo:256: 10000000:01000000:3.0:1789181334.100571:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789181334.100579:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc1c2175800/0x8f4f7840b2e40fcc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e40fd3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181334.100589:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.132@tcp lock: ffff9dc1c2175800/0x8f4f7840b2e40fcc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e40fd3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789181334.100597:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1789181334.100600:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1789181334.100603:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789181334.100624:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc1c2175200/0x8f4f7840b2e40fda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181334.100640:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.132@tcp lock: ffff9dc1c2175200/0x8f4f7840b2e40fda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181334.100649:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.132@tcp lock: ffff9dc1c2175200/0x8f4f7840b2e40fda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181334.100662:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6af2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510021376:0@lo:101: 00000100:00100000:3.0:1789181334.100689:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181334.100716:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1c03e7000 going to sleep for 11 seconds 00000100:00100000:0.0:1789181334.100948:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510021376 00000100:00100000:0.0:1789181334.100953:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510021376 00000100:00100000:0.0:1789181334.100982:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789181334.100988:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c372050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+14:5840:x1876092510021376:12345-0@lo:101: 00010000:00010000:0.0:1789181334.100995:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181334.101005:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc180031400/0x8f4f7840b2e40fe1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f4f7840b2e40fda expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181334.101022:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc180031400/0x8f4f7840b2e40fe1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f4f7840b2e40fda expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181334.101030:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc180031400/0x8f4f7840b2e40fe1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e40fda expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181334.101038:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc180031400, rc 0) 00000100:00100000:0.0:1789181334.101063:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c372050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+15:5840:x1876092510021376:12345-0@lo:101: Request processed in 76us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181334.101069:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789181334.101082:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6af2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510021376:0@lo:101: 00010000:00010000:3.0:1789181334.101094:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.132@tcp lock: ffff9dc1c2175200/0x8f4f7840b2e40fda lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e40fe1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181334.101103:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.132@tcp lock: ffff9dc1c2175200/0x8f4f7840b2e40fda lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f4f7840b2e40fe1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181334.101150:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6af2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510021504:0@lo:501: 00000100:00100000:3.0:1789181334.101177:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181334.101211:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1c03e7000 going to sleep for 11 seconds 00000100:00100000:2.0:1789181334.102102:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510021504 00000100:00100000:2.0:1789181334.102110:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510021504 00000100:00100000:2.0:1789181334.102147:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789181334.102155:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c372850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+15:5840:x1876092510021504:12345-0@lo:501: 00000100:00100000:2.0:1789181334.102480:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c372850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+15:5840:x1876092510021504:12345-0@lo:501: Request processed in 325us (1301us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181334.102488:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789181334.102546:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6af2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510021504:0@lo:501: 00000100:00100000:3.0:1789181334.102583:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6af2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510021632:0@lo:503: 00000100:00100000:3.0:1789181334.102621:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181334.102650:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1c03e7000 going to sleep for 11 seconds 00000100:00100000:0.0:1789181334.103016:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510021632 00000100:00100000:0.0:1789181334.103028:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510021632 00000100:00100000:0.0:1789181334.103054:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789181334.103061:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c370050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+15:5840:x1876092510021632:12345-0@lo:503: 00000100:00100000:0.0:1789181334.103403:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c370050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+15:5840:x1876092510021632:12345-0@lo:503: Request processed in 342us (781us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181334.103411:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789181334.103449:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6af2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510021632:0@lo:503: 00000100:00100000:0.0:1789181334.103820:0:6883:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6b51f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:880710ad-110c-42a4-a174-ab1b99a7ebeb:6883:1876092510021760:0@lo:502: 00000100:00100000:0.0:1789181334.103854:0:6883:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181334.103894:0:6883:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc189a44840 going to sleep for 11 seconds 00000100:00100000:1.0:1789181334.103988:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510021760 00000100:00100000:1.0:1789181334.103993:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510021760 00000100:00100000:1.0:1789181334.104027:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789181334.104034:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc18683f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+15:6883:x1876092510021760:12345-0@lo:502: 00000100:00100000:1.0:1789181334.104241:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc18683f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+15:6883:x1876092510021760:12345-0@lo:502: Request processed in 207us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181334.104248:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789181334.104316:0:6883:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6b51f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:880710ad-110c-42a4-a174-ab1b99a7ebeb:6883:1876092510021760:0@lo:502: 00000020:01000000:0.0:1789181334.104368:0:6883:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789181334.104376:0:6883:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1789181334.104383:0:6883:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789181334.104385:0:6883:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1789181334.104390:0:6883:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789181334.104394:0:6883:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.132@tcp to nid 0x20000c0a8cc84 (192.168.204.132@tcp) 00000020:01000000:0.0:1789181334.104416:0:6883:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1789181334.104419:0:6883:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789181334.104433:0:6883:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9dc1c1094d40) 00000020:00000080:0.0:1789181334.104454:0:6883:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:0.0:1789181334.104459:0:6883:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789181334.104538:0:6883:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1789181334.104543:0:6883:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:0.0:1789181334.104549:0:6883:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8f4f7840b2e40fef 00010000:00080000:0.0:1789181334.104573:0:6883:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dc1878b7000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.132@tcp at head 00010000:00010000:0.0:1789181334.104776:0:6883:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1789181334.168207:0:6883:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1789181334.168244:0:6883:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1789181334.168728:0:6883:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789181334.169998:0:6883:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789181334.170070:0:6883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1789181334.170126:0:6883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1789181334.172292:0:6884:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789181334.172299:0:6884:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1789181334.176805:0:6883:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789181334.176819:0:6883:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789181334.176853:0:6883:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1789181334.177296:0:6883:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8f4f7840b2e40ff6 00000100:00080000:0.0:1789181334.177308:0:6883:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789181334.177321:0:6883:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9dc1878b7000 using connection 192.168.204.132@tcp/0@lo 00000100:00100000:0.0:1789181334.177386:0:6883:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc1b6b51f80 x1876092510021888/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789181334.177406:0:6883:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1789181334.177461:0:6883:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789181334.177466:0:6883:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789181334.177468:0:6883:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1789181334.177472:0:6883:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789181334.177475:0:6883:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789181334.177477:0:6883:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789181334.177480:0:6883:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789181334.177482:0:6883:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1789181334.177507:0:6883:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6b51880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:880710ad-110c-42a4-a174-ab1b99a7ebeb:6883:1876092510022016:0@lo:502: 00000100:00100000:0.0:1789181334.177588:0:6883:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181334.177636:0:6883:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1b66edf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789181334.177862:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6b51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876092510022144:0@lo:400: 00000100:00100000:2.0:1789181334.177975:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181334.178005:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789181334.178011:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6b50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1876092510022272:0@lo:400: 00000100:00100000:2.0:1789181334.178036:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181334.178075:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510022144 00000100:00100000:2.0:1789181334.178082:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510022144 00000100:00100000:2.0:1789181334.178118:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510022272 00000100:00100000:2.0:1789181334.178121:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510022272 00000100:00100000:2.0:1789181334.178147:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789181334.178155:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc18854b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876092510022144:12345-0@lo:400: 00000100:00100000:2.0:1789181334.178222:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc18854b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876092510022144:12345-0@lo:400: Request processed in 67us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181334.178229:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789181334.178570:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6b51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1876092510021888:0@lo:8: 00000100:00100000:3.0:1789181334.178608:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181334.178711:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510021888 00000100:00100000:3.0:1789181334.178716:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510021888 00000100:00100000:3.0:1789181334.178739:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789181334.178745:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6af3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3302:x1876092510021888:12345-0@lo:8: 00010000:00080000:3.0:1789181334.178767:0:6691:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 226 last 0 00000020:00000080:3.0:1789181334.178794:0:6691:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8f4f7840b2e40ffd 00002000:00100000:3.0:1789181334.178830:0:6691:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9dc081295800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1789181334.178835:0:6691:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:3.0:1789181334.178839:0:6691:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:0.0:1789181334.178984:0:5842:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789181334.178993:0:5842:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1789181334.179165:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510022016 00000100:00100000:1.0:1789181334.179171:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510022016 00000100:00100000:1.0:1789181334.179214:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789181334.179222:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc18683f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+15:6883:x1876092510022016:12345-0@lo:502: 00000100:00100000:1.0:1789181334.179491:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc18683f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+15:6883:x1876092510022016:12345-0@lo:502: Request processed in 270us (1903us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181334.179498:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789181334.179554:0:6883:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6b51880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:880710ad-110c-42a4-a174-ab1b99a7ebeb:6883:1876092510022016:0@lo:502: 00000020:01000000:1.0:1789181334.179587:0:6883:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789181334.179594:0:6883:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789181334.179597:0:6883:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789181334.179602:0:6883:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:1.0:1789181334.179715:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1789181334.179731:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.132@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789181334.179740:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc1c2175200/0x8f4f7840b2e40fda lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e40fe1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181334.179753:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.132@tcp lock: ffff9dc1c2175200/0x8f4f7840b2e40fda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e40fe1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789181334.179762:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1789181334.179771:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9dc18851cd40 from 1 10000000:01000000:1.0:1789181334.179774:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789181334.179801:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc1c2044600/0x8f4f7840b2e41004 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181334.179809:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.132@tcp lock: ffff9dc1c2044600/0x8f4f7840b2e41004 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181334.179819:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.132@tcp lock: ffff9dc1c2044600/0x8f4f7840b2e41004 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181334.179832:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1baba5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510022400:0@lo:101: 00000100:00100000:2.0:1789181334.180544:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789181334.180555:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc18854aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876092510022272:12345-0@lo:400: 00000100:00100000:2.0:1789181334.180604:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc18854aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876092510022272:12345-0@lo:400: Request processed in 52us (2566us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181334.180621:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1789181334.180646:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789181334.180674:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dc1b6b50700 x1876092510022272/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181350 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181334.180687:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6b50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1876092510022272:0@lo:400: 00010000:00080000:2.0:1789181334.180701:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dc1b6b51180 x1876092510022144/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181350 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181334.180710:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6b51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876092510022144:0@lo:400: 00002000:00100000:3.0:1789181334.181077:0:6691:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789181334.181265:0:6691:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789181334.181294:0:6691:0:(import.c:65:import_set_state_nolock()) ffff9dc081297000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789181334.181365:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6af3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3302:x1876092510021888:12345-0@lo:8: Request processed in 2618us (2755us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181334.181373:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789181334.181409:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dc1b6b51f80 x1876092510021888/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789181344 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181334.181419:0:3302:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789181334.181425:0:3302:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1789181334.181432:0:3302:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789181334.181437:0:3302:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1789181334.181440:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9dc1878b7000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789181334.181449:0:3302:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789181334.181454:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6b51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1876092510021888:0@lo:8: 00000004:00080000:3.0:1789181334.182126:0:6884:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1789181334.184091:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181334.184161:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1aa457900 going to sleep for 11 seconds 00000100:00100000:2.0:1789181334.185991:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510022400 00000100:00100000:2.0:1789181334.186005:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510022400 00000100:00100000:2.0:1789181334.186058:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789181334.186068:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc18683c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+15:5840:x1876092510022400:12345-0@lo:101: 00010000:00010000:2.0:1789181334.186087:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181334.186104:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc18151a000/0x8f4f7840b2e4100b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f4f7840b2e41004 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181334.186130:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc18151a000/0x8f4f7840b2e4100b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f4f7840b2e41004 expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181334.186141:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc18151a000/0x8f4f7840b2e4100b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e41004 expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181334.186150:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc18151a000, rc 0) 00000100:00100000:2.0:1789181334.186228:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc18683c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+16:5840:x1876092510022400:12345-0@lo:101: Request processed in 162us (6360us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181334.186245:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789181334.186312:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1baba5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510022400:0@lo:101: 00010000:00010000:2.0:1789181334.186344:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.132@tcp lock: ffff9dc1c2044600/0x8f4f7840b2e41004 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e4100b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181334.186355:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.132@tcp lock: ffff9dc1c2044600/0x8f4f7840b2e41004 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f4f7840b2e4100b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181334.186417:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc188548000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510022528:0@lo:501: 00000100:00100000:2.0:1789181334.186447:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181334.186465:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc081837240 going to sleep for 11 seconds 00000100:00100000:2.0:1789181334.186478:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510022528 00000100:00100000:2.0:1789181334.186482:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510022528 00000100:00100000:2.0:1789181334.186499:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789181334.186504:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189956c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+16:5840:x1876092510022528:12345-0@lo:501: 00000100:00100000:2.0:1789181334.186701:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189956c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+16:5840:x1876092510022528:12345-0@lo:501: Request processed in 196us (253us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789181334.186709:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789181334.186737:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc188548000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510022528:0@lo:501: 10000000:01000000:2.0:1789181334.186758:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.132@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789181334.186764:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc1c2044600/0x8f4f7840b2e41004 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e4100b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181334.186773:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.132@tcp lock: ffff9dc1c2044600/0x8f4f7840b2e41004 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e4100b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789181334.187440:0:6884:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 226444107213ns, next at 0ns, rc = 0 00000004:00080000:3.0:1789181334.274401:0:6885:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:3.0:1789181334.274443:0:6885:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6af0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6885:1876092510022784:0@lo:7: 00000100:00100000:3.0:1789181334.274506:0:6885:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181334.274557:0:6885:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1c03e7000 going to sleep for 11 seconds 00000100:00100000:3.0:1789181334.274605:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6af2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876092510022656:0@lo:13: 00000100:00100000:3.0:1789181334.274630:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181334.274668:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510022784 00000100:00100000:3.0:1789181334.274676:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510022784 00000100:00100000:3.0:1789181334.274727:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789181334.274736:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6af3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6885:x1876092510022784:12345-0@lo:7: 00000100:00100000:3.0:1789181334.285353:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510022656 00000100:00100000:3.0:1789181334.285368:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510022656 00000100:00100000:3.0:1789181334.285421:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789181334.285431:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6af0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1876092510022656:12345-0@lo:13: 00002000:00000024:3.0:1789181334.285466:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1789181334.285545:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6af0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1876092510022656:12345-0@lo:13: Request processed in 116us (10913us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181334.285552:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1789181334.285574:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789181334.289395:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dc1b6af2300 x1876092510022656/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181350 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181334.289419:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6af2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876092510022656:0@lo:13: 00002000:00080000:3.0:1789181334.301708:0:6693:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1789181334.301719:0:6693:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00010000:00080000:2.0:1789181334.307391:0:6885:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dc1b6af0e00 x1876092510022784/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789181350 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181334.307427:0:6885:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6af0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6885:1876092510022784:0@lo:7: 00000004:00080000:2.0:1789181334.307443:0:6885:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1789181334.307487:0:6885:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc188548000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6885:1876092510022912:0@lo:5: 00000100:00100000:2.0:1789181334.307552:0:6885:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181334.307602:0:6885:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc186df8000 going to sleep for 11 seconds 00000100:00100000:0.0:1789181334.307684:0:6691:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1789181334.307692:0:6691:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1789181334.308010:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510022912 00000100:00100000:0.0:1789181334.308017:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510022912 00000100:00100000:0.0:1789181334.308125:0:6894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789181334.308134:0:6894:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc188549180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:6885:x1876092510022912:12345-0@lo:5: 00002000:00080000:0.0:1789181334.308162:0:6894:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1789181334.308165:0:6894:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1789181334.308587:0:6894:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc188549180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:6885:x1876092510022912:12345-0@lo:5: Request processed in 452us (1033us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1789181334.308594:0:6894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789181334.308742:0:6885:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dc188548000 x1876092510022912/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789181350 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181334.308765:0:6885:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc188548000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6885:1876092510022912:0@lo:5: 00000004:00080000:2.0:1789181334.308776:0:6885:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1789181334.308807:0:6885:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc188548700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6885:1876092510023040:0@lo:700: 00000100:00100000:2.0:1789181334.308851:0:6885:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181334.309986:0:6885:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc186df8000 going to sleep for 11 seconds 00000100:00100000:3.0:1789181334.310256:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6af3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:6885:x1876092510022784:12345-0@lo:7: Request processed in 35519us (35747us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181334.310267:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789181334.320999:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510023040 00000100:00100000:0.0:1789181334.321013:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510023040 00000100:00100000:0.0:1789181334.321074:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789181334.321085:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc188549500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6885:x1876092510023040:12345-0@lo:700: 00000100:00100000:0.0:1789181334.321145:0:6700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6b51500 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6700:1876092510023168:0@lo:700: 00000100:00100000:0.0:1789181334.321220:0:6700:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181334.321260:0:6700:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1b6b7e240 going to sleep for 11 seconds 00000100:00100000:3.0:1789181334.331078:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510023168 00000100:00100000:3.0:1789181334.331101:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510023168 00000100:00100000:3.0:1789181334.331161:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789181334.331173:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6b52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6700:x1876092510023168:12345-0@lo:700: 00000004:00080000:2.0:1789181334.396708:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 40000000:02000000:2.0:1789181334.463125:0:5849:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:2.0:1789181334.471066:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6b52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6700:x1876092510023168:12345-0@lo:700: Request processed in 139888us (149838us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181334.471106:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789181334.471204:0:6700:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dc1b6b51500 x1876092510023168/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789181350 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181334.471218:0:6700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6b51500 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6700:1876092510023168:0@lo:700: 40000000:02000000:0.0:1789181334.471291:0:6700:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:1.0:1789181334.604656:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:1.0:1789181334.604681:0:6718:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1789181334.609913:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc188549500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6885:x1876092510023040:12345-0@lo:700: Request processed in 288822us (301052us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181334.609933:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789181334.610388:0:6885:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dc188548700 x1876092510023040/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789181350 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181334.610400:0:6885:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1789181334.610415:0:6885:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc188548700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6885:1876092510023040:0@lo:700: 00000004:02000040:0.0:1789181334.679688:0:6885:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:1.0:1789181334.692025:0:6885:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1baba5880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6885:1876092510023296:0@lo:5: 00000100:00100000:1.0:1789181334.692099:0:6885:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181334.692166:0:6885:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc18a15dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789181334.692710:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510023296 00000100:00100000:0.0:1789181334.692726:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510023296 00000100:00100000:0.0:1789181334.692787:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789181334.692796:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1baba7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:6885:x1876092510023296:12345-0@lo:5: 00002000:00080000:2.0:1789181334.710628:0:6691:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1789181334.710650:0:6691:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:0.0:1789181334.725984:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1baba7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6885:x1876092510023296:12345-0@lo:5: Request processed in 33179us (33875us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1789181334.725997:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789181334.726166:0:6885:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dc1baba5880 x1876092510023296/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789181350 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181334.726215:0:6885:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1baba5880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6885:1876092510023296:0@lo:5: 00000004:00080000:2.0:1789181334.726238:0:6885:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:0.0:1789181335.119038:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181336.126696:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181337.150881:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789181337.428217:0:7064:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg432-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789181338.175246:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181339.198508:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181339.646710:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6b51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:880710ad-110c-42a4-a174-ab1b99a7ebeb:3304:1876092510023424:0@lo:400: 00000100:00100000:1.0:1789181339.646797:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181339.646985:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510023424 00000100:00100000:2.0:1789181339.646994:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510023424 00000100:00100000:3.0:1789181339.647036:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6b50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1876092510023680:0@lo:400: 00000100:00100000:3.0:1789181339.647074:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181339.647115:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789181339.647124:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6b53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876092510023552:0@lo:400: 00000100:00100000:2.0:1789181339.647131:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789181339.647143:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189954c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+16:3304:x1876092510023424:12345-0@lo:400: 00000100:00100000:3.0:1789181339.647152:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181339.647197:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510023680 00000100:00100000:3.0:1789181339.647201:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510023680 00000100:00100000:3.0:1789181339.647237:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510023552 00000100:00100000:3.0:1789181339.647240:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510023552 00000100:00100000:3.0:1789181339.647261:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789181339.647268:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6af2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876092510023680:12345-0@lo:400: 00000100:00100000:3.0:1789181339.647309:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6af2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876092510023680:12345-0@lo:400: Request processed in 41us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181339.647316:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789181339.647352:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789181339.647358:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6af2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876092510023552:12345-0@lo:400: 00000100:00100000:3.0:1789181339.647387:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6af2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876092510023552:12345-0@lo:400: Request processed in 30us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181339.647393:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789181339.649271:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6af1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876092510023936:0@lo:13: 00000100:00100000:1.0:1789181339.649356:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181339.649745:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6b52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876092510023808:0@lo:400: 00000100:00100000:2.0:1789181339.649801:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189954c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+16:3304:x1876092510023424:12345-0@lo:400: Request processed in 2658us (3001us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181339.649812:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789181339.650228:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6b51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:880710ad-110c-42a4-a174-ab1b99a7ebeb:3304:1876092510023424:0@lo:400: 00000100:00080000:3.0:1789181339.650684:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789181339.650705:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510023936 00000100:00100000:3.0:1789181339.650713:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510023936 00000100:00100000:3.0:1789181339.650769:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789181339.650778:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1baba6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1876092510023936:12345-0@lo:13: 00002000:00000024:3.0:1789181339.650813:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789181339.651005:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1baba6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1876092510023936:12345-0@lo:13: Request processed in 227us (1647us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181339.651014:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1789181339.651034:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789181339.651073:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1789181339.651087:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dc1b6b53480 x1876092510023552/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181355 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181339.651209:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6b53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876092510023552:0@lo:400: 00010000:00080000:3.0:1789181339.651226:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dc1b6b50000 x1876092510023680/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181355 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181339.651235:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6b50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1876092510023680:0@lo:400: 00000100:00100000:3.0:1789181339.651277:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510023808 00000100:00100000:3.0:1789181339.651281:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510023808 00000100:00100000:3.0:1789181339.651396:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789181339.651405:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6b53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3303:x1876092510023808:12345-0@lo:400: 00000100:00100000:3.0:1789181339.651447:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6b53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3303:x1876092510023808:12345-0@lo:400: Request processed in 44us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181339.651454:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789181339.651712:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dc1b6af1c00 x1876092510023936/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181355 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181339.651956:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6af1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876092510023936:0@lo:13: 00010000:00080000:0.0:1789181339.652398:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dc1b6b52a00 x1876092510023808/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181355 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181339.652410:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6b52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876092510023808:0@lo:400: 00000001:00080000:1.0:1789181339.746810:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:0.0:1789181340.223134:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181341.246573:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181342.271001:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181343.294681:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181344.318654:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789181344.766628:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6b52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:880710ad-110c-42a4-a174-ab1b99a7ebeb:3305:1876092510024064:0@lo:400: 00000100:00100000:3.0:1789181344.766698:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181344.766835:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510024064 00000100:00100000:1.0:1789181344.766852:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510024064 00000100:00100000:1.0:1789181344.766901:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789181344.766910:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189955450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+16:3305:x1876092510024064:12345-0@lo:400: 00000100:00100000:2.0:1789181344.770388:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6b50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876092510024448:0@lo:400: 00000100:00100000:2.0:1789181344.770457:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181344.774835:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6b50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1876092510024320:0@lo:400: 00000100:00100000:0.0:1789181344.774912:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181344.776464:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189955450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+16:3305:x1876092510024064:12345-0@lo:400: Request processed in 9547us (9757us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181344.776477:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789181344.777641:0:6894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510024448 00000100:00100000:1.0:1789181344.777652:0:6894:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510024448 00000100:00100000:1.0:1789181344.777715:0:6894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789181344.777725:0:6894:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc18854a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1876092510024448:12345-0@lo:400: 00000100:00100000:1.0:1789181344.777805:0:6894:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc18854a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1876092510024448:12345-0@lo:400: Request processed in 81us (7347us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181344.777812:0:6894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1789181344.777832:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789181344.777870:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dc1b6b50000 x1876092510024448/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181360 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181344.777882:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1789181344.777899:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6b50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876092510024448:0@lo:400: 00000100:00100000:3.0:1789181344.778172:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6b52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:880710ad-110c-42a4-a174-ab1b99a7ebeb:3305:1876092510024064:0@lo:400: 00000100:00100000:3.0:1789181344.778186:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789181344.778201:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510024320 00000100:00100000:3.0:1789181344.778204:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510024320 00000100:00100000:3.0:1789181344.778239:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789181344.778246:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6b53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876092510024320:12345-0@lo:400: 00000100:00100000:3.0:1789181344.778292:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6b53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876092510024320:12345-0@lo:400: Request processed in 47us (3381us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181344.778309:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789181344.778405:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789181344.778417:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6af3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876092510024576:0@lo:13: 00000100:00100000:3.0:1789181344.778449:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789181344.779631:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789181344.779873:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510024576 00000100:00100000:3.0:1789181344.779881:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510024576 00000100:00100000:3.0:1789181344.779919:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789181344.779928:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6af0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876092510024576:12345-0@lo:13: 00002000:00000024:3.0:1789181344.779958:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789181344.780673:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6af0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876092510024576:12345-0@lo:13: Request processed in 744us (2221us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181344.780682:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789181344.787129:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dc1b6af3b80 x1876092510024576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181360 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181344.787159:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6af3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876092510024576:0@lo:13: 00010000:00080000:3.0:1789181344.788630:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dc1b6b50e00 x1876092510024320/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181360 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181344.788647:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6b50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1876092510024320:0@lo:400: 00000100:00100000:3.0:1789181344.790207:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6b52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876092510024192:0@lo:400: 00000100:00100000:3.0:1789181344.790281:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181344.790440:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510024192 00000100:00100000:1.0:1789181344.790448:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510024192 00000100:00100000:1.0:1789181344.790499:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789181344.790509:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6af1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876092510024192:12345-0@lo:400: 00000100:00100000:1.0:1789181344.790645:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6af1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876092510024192:12345-0@lo:400: Request processed in 137us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181344.790663:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1789181344.792324:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dc1b6b52300 x1876092510024192/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181360 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181344.792368:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6b52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876092510024192:0@lo:400: 00010000:00010000:1.0:1789181345.353456:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181346.367078:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181347.390525:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181348.416408:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789181348.742682:0:7632:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789181348.742686:0:7632:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1789181348.742820:0:7632:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9dc08132f800 00000020:01000004:3.0:1789181348.742838:0:7632:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1789181348.742850:0:7632:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1789181348.742872:0:7632:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9dc18981cd40) 00000020:00000080:3.0:1789181348.742894:0:7632:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1789181348.772318:0:7632:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1789181348.772662:0:7632:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1789181348.830146:0:7632:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1789181348.839098:0:7632:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1789181348.839134:0:7632:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1789181348.839193:0:7632:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1789181348.839222:0:7632:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1789181348.839786:0:7632:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1789181348.839800:0:7632:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789181348.839809:0:7632:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x8f4f7840b2e41019 00000020:01000004:3.0:1789181348.839891:0:7632:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1789181348.839925:0:7632:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.132@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789181348.839929:0:7632:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.132@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789181348.839936:0:7632:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1789181348.839959:0:7632:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1789181348.839964:0:7632:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.132@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1789181348.868574:0:7632:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.132@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789181348.868613:0:7632:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.132@tcp, index=0001, flags=0x20062 00000020:01000004:1.0:1789181348.868618:0:7632:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789181348.868620:0:7632:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789181348.868621:0:7632:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789181348.868623:0:7632:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789181348.868624:0:7632:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789181348.868626:0:7632:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789181348.868627:0:7632:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789181348.868629:0:7632:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789181348.868630:0:7632:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789181348.868632:0:7632:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789181348.868633:0:7632:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789181348.868636:0:7632:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:1.0:1789181348.868639:0:7632:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789181348.868640:0:7632:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789181348.868641:0:7632:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789181348.868642:0:7632:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789181348.868643:0:7632:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789181348.868644:0:7632:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789181348.868645:0:7632:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789181348.868647:0:7632:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789181348.868648:0:7632:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789181348.868649:0:7632:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789181348.868650:0:7632:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789181348.868686:0:7632:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1789181348.868705:0:7632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1baba5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:7632:1876092510024704:0@lo:253: 00000100:00100000:1.0:1789181348.868772:0:7632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181348.868836:0:7632:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1b64729c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789181348.872082:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510024704 00000100:00100000:3.0:1789181348.872098:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510024704 00000100:00100000:3.0:1789181348.872170:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789181348.872182:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189955050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+16:7632:x1876092510024704:12345-0@lo:253: 20000000:01000000:3.0:1789181348.872254:0:5837:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1789181348.872259:0:5837:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:3.0:1789181348.872265:0:5837:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:3.0:1789181348.872268:0:5837:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1789181348.873371:0:5837:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789181348.873613:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1789181348.873630:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1789181348.873674:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1789181348.873696:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:3.0:1789181348.873734:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1789181348.873785:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1789181348.874185:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1789181348.874206:0:5837:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.132@tcp 20000000:01000000:3.0:1789181348.874208:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.132@tcp (null) (null) (null) 00000040:00080000:3.0:1789181348.874249:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1789181348.874257:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789181348.874307:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1789181348.874315:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.204.132@tcp (null) (null) 00000040:00080000:3.0:1789181348.874382:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1789181348.874394:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1789181348.874428:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1789181348.874500:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1789181348.884441:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:3.0:1789181348.884479:0:5837:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.132@tcp 20000000:01000000:3.0:1789181348.884482:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.132@tcp (null) (null) (null) 00000040:00080000:3.0:1789181348.884552:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:3.0:1789181348.884560:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1789181348.884593:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:3.0:1789181348.884603:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.204.132@tcp (null) (null) 00000040:00080000:3.0:1789181348.884635:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:3.0:1789181348.884645:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1789181348.884689:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:3.0:1789181348.884721:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:3.0:1789181348.884742:0:5837:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:3.0:1789181348.884745:0:5837:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1789181348.884749:0:5837:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1789181348.884762:0:5837:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1789181348.884764:0:5837:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1789181348.884806:0:5837:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1789181348.884808:0:5837:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789181348.890516:0:7633:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:0.0:1789181348.890635:0:7633:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:0.0:1789181348.890684:0:7633:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:3.0:1789181348.891558:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:3.0:1789181348.891608:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:3.0:1789181348.891668:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:3.0:1789181348.891682:0:5837:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789181348.891684:0:5837:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789181348.892631:0:7634:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 15 1->4: lustre sys.timeout 20000000:01000000:1.0:1789181348.892695:0:7634:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 15 2->4: lustre sys.timeout 00000040:00080000:1.0:1789181348.892755:0:7634:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1789181348.893045:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1789181348.893084:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1789181348.893152:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:3.0:1789181348.893251:0:5837:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1789181348.893254:0:5837:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1789181348.893905:0:7635:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1789181348.897823:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1789181348.897888:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1789181348.897984:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1789181348.898003:0:5837:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1789181348.898006:0:5837:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789181348.901039:0:7636:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 16 1->4: lustre sys.timeout 20000000:01000000:3.0:1789181348.901146:0:7636:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 16 2->4: lustre sys.timeout 00000040:00080000:3.0:1789181348.903121:0:7636:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1789181348.904745:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:2.0:1789181348.904799:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:2.0:1789181348.904835:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:2.0:1789181348.904860:0:5837:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:2.0:1789181348.904862:0:5837:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:2.0:1789181348.904871:0:5837:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789181348.904891:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dc18151ac00/0x8f4f7840b2e41020 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181348.904909:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dc1c2044e00/0x8f4f7840b2e40f71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e40f6a expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181348.904926:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dc180030c00/0x8f4f7840b2e40f9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e40f94 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181348.904934:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dc18151a800/0x8f4f7840b2e40fc5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e40fbe expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181348.904941:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dc180031400/0x8f4f7840b2e40fe1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e40fda expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181348.904948:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dc18151a000/0x8f4f7840b2e4100b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e41004 expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181348.907385:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9dc18151ac00/0x8f4f7840b2e41020 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181348.907438:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dc18151a000/0x8f4f7840b2e4100b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8f4f7840b2e41004 expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181348.907455:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dc18151a000/0x8f4f7840b2e4100b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8f4f7840b2e41004 expref: 16 pid: 5836 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181348.907470:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc18854b480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5837:1876092510024832:0@lo:104: 00000100:00100000:2.0:1789181348.907911:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789181348.907995:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dc180031400/0x8f4f7840b2e40fe1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8f4f7840b2e40fda expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181348.908005:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dc180031400/0x8f4f7840b2e40fe1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8f4f7840b2e40fda expref: 16 pid: 5836 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181348.908016:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc18854bb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5837:1876092510024960:0@lo:104: 00010000:00010000:2.0:1789181348.908054:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dc18151a800/0x8f4f7840b2e40fc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8f4f7840b2e40fbe expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181348.908062:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dc18151a800/0x8f4f7840b2e40fc5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8f4f7840b2e40fbe expref: 16 pid: 5837 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181348.908069:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc188548380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5837:1876092510025088:0@lo:104: 00010000:00010000:2.0:1789181348.908093:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dc180030c00/0x8f4f7840b2e40f9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8f4f7840b2e40f94 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181348.908100:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dc180030c00/0x8f4f7840b2e40f9b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8f4f7840b2e40f94 expref: 16 pid: 5835 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181348.908107:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc188549f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5837:1876092510025216:0@lo:104: 00010000:00010000:2.0:1789181348.908128:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dc1c2044e00/0x8f4f7840b2e40f71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8f4f7840b2e40f6a expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181348.908136:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dc1c2044e00/0x8f4f7840b2e40f71 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8f4f7840b2e40f6a expref: 16 pid: 5836 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181348.908143:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc188549880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5837:1876092510025344:0@lo:104: 00000100:00100000:2.0:1789181348.908160:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1c03ce000 going to sleep for 11 seconds 00000100:00100000:3.0:1789181348.910083:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789181348.910156:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181348.910198:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181348.910209:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181348.910219:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181348.910232:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510024832 00000100:00100000:0.0:1789181348.910252:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510024832 00000100:00100000:0.0:1789181348.910301:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510024960 00000100:00100000:0.0:1789181348.910304:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510024960 00000100:00100000:0.0:1789181348.910314:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510025088 00000100:00100000:0.0:1789181348.910316:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510025088 00000100:00100000:0.0:1789181348.910323:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510025216 00000100:00100000:0.0:1789181348.910325:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510025216 00000100:00100000:0.0:1789181348.910352:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510025344 00000100:00100000:0.0:1789181348.910354:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510025344 00000100:00100000:0.0:1789181348.910367:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789181348.910376:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc18687ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:880710ad-110c-42a4-a174-ab1b99a7ebeb+7:5837:x1876092510024832:12345-0@lo:104: 00010000:00010000:0.0:1789181348.910392:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.132@tcp lock: ffff9dc1c2044600/0x8f4f7840b2e41004 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f4f7840b2e4100b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181348.910461:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789181348.910467:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc18687ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:880710ad-110c-42a4-a174-ab1b99a7ebeb+7:5837:x1876092510024832:12345-0@lo:104: Request processed in 94us (2558us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181348.910474:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789181348.910515:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789181348.910520:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6b51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:880710ad-110c-42a4-a174-ab1b99a7ebeb+6:5837:x1876092510024960:12345-0@lo:104: 00010000:00010000:0.0:1789181348.910528:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.132@tcp lock: ffff9dc1c2175200/0x8f4f7840b2e40fda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f4f7840b2e40fe1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181348.910560:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789181348.910565:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6b51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:880710ad-110c-42a4-a174-ab1b99a7ebeb+6:5837:x1876092510024960:12345-0@lo:104: Request processed in 46us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181348.910572:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789181348.910583:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789181348.910589:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6b51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:880710ad-110c-42a4-a174-ab1b99a7ebeb+5:5837:x1876092510025088:12345-0@lo:104: 00010000:00010000:0.0:1789181348.910605:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.132@tcp lock: ffff9dc1c2044000/0x8f4f7840b2e40fbe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f4f7840b2e40fc5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181348.910634:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789181348.910639:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6b51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:880710ad-110c-42a4-a174-ab1b99a7ebeb+5:5837:x1876092510025088:12345-0@lo:104: Request processed in 51us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181348.910645:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789181348.910656:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789181348.910662:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6b51180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:880710ad-110c-42a4-a174-ab1b99a7ebeb+4:5837:x1876092510025216:12345-0@lo:104: 00010000:00010000:0.0:1789181348.910668:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.132@tcp lock: ffff9dc18151be00/0x8f4f7840b2e40f94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f4f7840b2e40f9b expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181348.910694:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1789181348.910699:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6b51180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:880710ad-110c-42a4-a174-ab1b99a7ebeb+4:5837:x1876092510025216:12345-0@lo:104: Request processed in 38us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181348.910705:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789181348.910716:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789181348.910721:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6b50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:880710ad-110c-42a4-a174-ab1b99a7ebeb+3:5837:x1876092510025344:12345-0@lo:104: 00010000:00010000:0.0:1789181348.910728:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.132@tcp lock: ffff9dc18151b000/0x8f4f7840b2e40f6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f4f7840b2e40f71 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181348.910753:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1789181348.910759:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6b50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:880710ad-110c-42a4-a174-ab1b99a7ebeb+3:5837:x1876092510025344:12345-0@lo:104: Request processed in 38us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181348.910764:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1789181348.910782:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1789181348.910788:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.132@tcp lock: ffff9dc1c2044600/0x8f4f7840b2e41004 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f4f7840b2e4100b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181348.910801:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1c2044600 already unused, calling callback (ffffffffc1b45c20) 10000000:00010000:0.0:1789181348.910805:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.132@tcp lock: ffff9dc1c2044600/0x8f4f7840b2e41004 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x8f4f7840b2e4100b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181348.910814:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.132@tcp lock: ffff9dc1c2044600/0x8f4f7840b2e41004 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x8f4f7840b2e4100b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789181348.910820:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.132@tcp lock: ffff9dc1c2044600/0x8f4f7840b2e41004 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x8f4f7840b2e4100b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789181348.910826:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789181348.910988:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.132@tcp lock: ffff9dc1c2044600/0x8f4f7840b2e41004 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e4100b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181348.910996:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789181348.911015:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.132@tcp lock: ffff9dc1c2044600/0x8f4f7840b2e41004 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e4100b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181348.911022:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.132@tcp lock: ffff9dc1c2044600/0x8f4f7840b2e41004 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e4100b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181348.911045:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1789181348.911049:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.132@tcp lock: ffff9dc1c2175200/0x8f4f7840b2e40fda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f4f7840b2e40fe1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181348.911055:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1c2175200 already unused, calling callback (ffffffffc1b45c20) 10000000:00010000:0.0:1789181348.911058:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.132@tcp lock: ffff9dc1c2175200/0x8f4f7840b2e40fda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x8f4f7840b2e40fe1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181348.911077:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.132@tcp lock: ffff9dc1c2175200/0x8f4f7840b2e40fda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x8f4f7840b2e40fe1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789181348.911083:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.132@tcp lock: ffff9dc1c2175200/0x8f4f7840b2e40fda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x8f4f7840b2e40fe1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789181348.911088:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789181348.911101:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.132@tcp lock: ffff9dc1c2175200/0x8f4f7840b2e40fda lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e40fe1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181348.911107:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789181348.911122:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.132@tcp lock: ffff9dc1c2175200/0x8f4f7840b2e40fda lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e40fe1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181348.911129:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.132@tcp lock: ffff9dc1c2175200/0x8f4f7840b2e40fda lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e40fe1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181348.911140:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789181348.911143:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.132@tcp lock: ffff9dc1c2044000/0x8f4f7840b2e40fbe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f4f7840b2e40fc5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181348.911149:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1c2044000 already unused, calling callback (ffffffffc1b45c20) 10000000:00010000:0.0:1789181348.911151:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.132@tcp lock: ffff9dc1c2044000/0x8f4f7840b2e40fbe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8f4f7840b2e40fc5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181348.911158:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.132@tcp lock: ffff9dc1c2044000/0x8f4f7840b2e40fbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8f4f7840b2e40fc5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789181348.911579:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.132@tcp lock: ffff9dc1c2044000/0x8f4f7840b2e40fbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8f4f7840b2e40fc5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789181348.911591:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789181348.911607:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.132@tcp lock: ffff9dc1c2044000/0x8f4f7840b2e40fbe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e40fc5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181348.911613:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789181348.911619:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.132@tcp lock: ffff9dc1c2044000/0x8f4f7840b2e40fbe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e40fc5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181348.911626:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.132@tcp lock: ffff9dc1c2044000/0x8f4f7840b2e40fbe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e40fc5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181348.911639:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789181348.911642:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.132@tcp lock: ffff9dc18151be00/0x8f4f7840b2e40f94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f4f7840b2e40f9b expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181348.911648:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc18151be00 already unused, calling callback (ffffffffc1b45c20) 10000000:00010000:0.0:1789181348.911650:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.132@tcp lock: ffff9dc18151be00/0x8f4f7840b2e40f94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8f4f7840b2e40f9b expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181348.911657:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.132@tcp lock: ffff9dc18151be00/0x8f4f7840b2e40f94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8f4f7840b2e40f9b expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789181348.911663:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.132@tcp lock: ffff9dc18151be00/0x8f4f7840b2e40f94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8f4f7840b2e40f9b expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789181348.911668:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789181348.911679:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.132@tcp lock: ffff9dc18151be00/0x8f4f7840b2e40f94 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e40f9b expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181348.911684:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789181348.911694:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.132@tcp lock: ffff9dc18151be00/0x8f4f7840b2e40f94 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e40f9b expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181348.911700:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.132@tcp lock: ffff9dc18151be00/0x8f4f7840b2e40f94 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e40f9b expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181348.911708:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789181348.911711:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.132@tcp lock: ffff9dc18151b000/0x8f4f7840b2e40f6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f4f7840b2e40f71 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181348.911716:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc18151b000 already unused, calling callback (ffffffffc1b45c20) 10000000:00010000:0.0:1789181348.911719:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.132@tcp lock: ffff9dc18151b000/0x8f4f7840b2e40f6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8f4f7840b2e40f71 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181348.911725:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.132@tcp lock: ffff9dc18151b000/0x8f4f7840b2e40f6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8f4f7840b2e40f71 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789181348.911731:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.132@tcp lock: ffff9dc18151b000/0x8f4f7840b2e40f6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8f4f7840b2e40f71 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789181348.911736:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789181348.911749:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.132@tcp lock: ffff9dc18151b000/0x8f4f7840b2e40f6a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e40f71 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181348.911755:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789181348.911759:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.132@tcp lock: ffff9dc18151b000/0x8f4f7840b2e40f6a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e40f71 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181348.911765:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.132@tcp lock: ffff9dc18151b000/0x8f4f7840b2e40f6a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e40f71 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181348.911779:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181348.911786:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181348.911788:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181348.911795:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181348.911818:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6b51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:880710ad-110c-42a4-a174-ab1b99a7ebeb:3306:1876092510025472:0@lo:103: 00000100:00100000:1.0:1789181348.912655:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6b52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:880710ad-110c-42a4-a174-ab1b99a7ebeb:3305:1876092510025856:0@lo:103: 00000100:00100000:1.0:1789181348.912701:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181348.912778:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc18854b480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5837:1876092510024832:0@lo:104: 00000100:00100000:1.0:1789181348.912788:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc18854bb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5837:1876092510024960:0@lo:104: 00000100:00100000:1.0:1789181348.912796:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc188548380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5837:1876092510025088:0@lo:104: 00000100:00100000:1.0:1789181348.912804:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc188549f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5837:1876092510025216:0@lo:104: 00000100:00100000:1.0:1789181348.912812:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc188549880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5837:1876092510025344:0@lo:104: 00010000:00010000:1.0:1789181348.912841:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9dc18151ac00/0x8f4f7840b2e41020 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181348.913111:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181348.913133:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6b50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:880710ad-110c-42a4-a174-ab1b99a7ebeb:3306:1876092510025984:0@lo:103: 00000100:00100000:3.0:1789181348.913141:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510025856 00000100:00100000:3.0:1789181348.913148:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510025856 00000100:00100000:0.0:1789181348.913152:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789181348.913173:0:6707:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dc180030c00/0x8f4f7840b2e40f9b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f4f7840b2e40f94 expref: 17 pid: 5835 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181348.913178:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6b50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:880710ad-110c-42a4-a174-ab1b99a7ebeb:3303:1876092510025600:0@lo:103: 00000100:00100000:0.0:1789181348.913197:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181348.915118:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789181348.915133:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6b51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:880710ad-110c-42a4-a174-ab1b99a7ebeb:3303:1876092510025728:0@lo:103: 00000100:00100000:0.0:1789181348.917031:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181348.920635:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510025472 00000100:00100000:3.0:1789181348.920650:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510025472 00010000:00010000:3.0:1789181348.920700:0:6707:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dc18151a000/0x8f4f7840b2e4100b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f4f7840b2e41004 expref: 18 pid: 5836 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181348.920727:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510025984 00000100:00100000:3.0:1789181348.920730:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510025984 00010000:00010000:3.0:1789181348.920742:0:6707:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dc1c2044e00/0x8f4f7840b2e40f71 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f4f7840b2e40f6a expref: 19 pid: 5836 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181348.920751:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510025600 00000100:00100000:3.0:1789181348.920753:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510025600 00010000:00010000:3.0:1789181348.920773:0:6707:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dc180031400/0x8f4f7840b2e40fe1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f4f7840b2e40fda expref: 20 pid: 5836 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181348.920809:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789181348.920816:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1baba6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:880710ad-110c-42a4-a174-ab1b99a7ebeb+20:3305:x1876092510025856:12345-0@lo:103: 00010000:00010000:3.0:1789181348.920829:0:6707:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789181348.920834:0:6707:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dc180030c00/0x8f4f7840b2e40f9b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f4f7840b2e40f94 expref: 20 pid: 5835 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181348.920844:0:6707:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dc180030c00/0x8f4f7840b2e40f9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8f4f7840b2e40f94 expref: 20 pid: 5835 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181348.920860:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc180030c00/0x8f4f7840b2e40f9b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8f4f7840b2e40f94 expref: 20 pid: 5835 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181348.920878:0:6707:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789181348.922852:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510025728 00000100:00100000:0.0:1789181348.922866:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510025728 00010000:00010000:0.0:1789181348.922896:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dc18151a800/0x8f4f7840b2e40fc5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f4f7840b2e40fbe expref: 20 pid: 5837 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181348.922933:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789181348.922942:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6b52300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:880710ad-110c-42a4-a174-ab1b99a7ebeb+20:3306:x1876092510025472:12345-0@lo:103: 00010000:00010000:0.0:1789181348.922953:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789181348.922959:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dc18151a000/0x8f4f7840b2e4100b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f4f7840b2e41004 expref: 20 pid: 5836 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181348.922970:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dc18151a000/0x8f4f7840b2e4100b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8f4f7840b2e41004 expref: 20 pid: 5836 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181348.922985:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc18151a000/0x8f4f7840b2e4100b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8f4f7840b2e41004 expref: 20 pid: 5836 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181348.923013:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789181348.923071:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6b52300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:3306:x1876092510025472:12345-0@lo:103: Request processed in 131us (9960us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181348.923079:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789181348.923165:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789181348.923173:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6b50e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:880710ad-110c-42a4-a174-ab1b99a7ebeb+18:3306:x1876092510025984:12345-0@lo:103: 00010000:00010000:0.0:1789181348.923184:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789181348.923188:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dc1c2044e00/0x8f4f7840b2e40f71 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f4f7840b2e40f6a expref: 18 pid: 5836 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181348.923196:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dc1c2044e00/0x8f4f7840b2e40f71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8f4f7840b2e40f6a expref: 18 pid: 5836 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181348.923205:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc1c2044e00/0x8f4f7840b2e40f71 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8f4f7840b2e40f6a expref: 18 pid: 5836 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181348.923226:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789181348.923250:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6b50e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:880710ad-110c-42a4-a174-ab1b99a7ebeb+17:3306:x1876092510025984:12345-0@lo:103: Request processed in 79us (10096us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181348.923256:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789181348.923269:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789181348.923275:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6b52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:880710ad-110c-42a4-a174-ab1b99a7ebeb+16:3303:x1876092510025600:12345-0@lo:103: 00010000:00010000:0.0:1789181348.923283:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789181348.923287:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dc180031400/0x8f4f7840b2e40fe1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f4f7840b2e40fda expref: 16 pid: 5836 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181348.923296:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dc180031400/0x8f4f7840b2e40fe1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8f4f7840b2e40fda expref: 16 pid: 5836 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181348.923314:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc180031400/0x8f4f7840b2e40fe1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8f4f7840b2e40fda expref: 16 pid: 5836 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181348.923324:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789181348.923384:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6b52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:880710ad-110c-42a4-a174-ab1b99a7ebeb+15:3303:x1876092510025600:12345-0@lo:103: Request processed in 109us (10185us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181348.923390:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789181348.923403:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789181348.923409:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6b50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:880710ad-110c-42a4-a174-ab1b99a7ebeb+14:3303:x1876092510025728:12345-0@lo:103: 00010000:00010000:0.0:1789181348.923416:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789181348.923420:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dc18151a800/0x8f4f7840b2e40fc5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f4f7840b2e40fbe expref: 14 pid: 5837 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181348.923428:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dc18151a800/0x8f4f7840b2e40fc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8f4f7840b2e40fbe expref: 14 pid: 5837 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181348.923438:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc18151a800/0x8f4f7840b2e40fc5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8f4f7840b2e40fbe expref: 14 pid: 5837 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181348.923448:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9dc18151ac00/0x8f4f7840b2e41020 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181348.923456:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc18151ac00/0x8f4f7840b2e41020 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181348.923472:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dc18151ac00/0x8f4f7840b2e41020 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181348.923479:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dc18151ac00/0x8f4f7840b2e41020 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181348.923491:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dc18151ac00/0x8f4f7840b2e41020 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181348.923500:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dc18151ac00/0x8f4f7840b2e41020 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181348.923508:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc18151ac00 already unused, calling callback (ffffffffc152f9b0) 00010000:00010000:0.0:1789181348.923512:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dc18151ac00/0x8f4f7840b2e41020 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181348.923520:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dc18151ac00/0x8f4f7840b2e41020 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181348.923537:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dc18151ac00/0x8f4f7840b2e41020 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181348.923548:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789181348.923572:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6b50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:880710ad-110c-42a4-a174-ab1b99a7ebeb+13:3303:x1876092510025728:12345-0@lo:103: Request processed in 164us (6548us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181348.923578:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789181348.923617:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6b51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:880710ad-110c-42a4-a174-ab1b99a7ebeb:3303:1876092510025728:0@lo:103: 00000100:00100000:3.0:1789181348.923632:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1baba6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:880710ad-110c-42a4-a174-ab1b99a7ebeb+12:3305:x1876092510025856:12345-0@lo:103: Request processed in 2813us (10927us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181348.923632:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6b50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:880710ad-110c-42a4-a174-ab1b99a7ebeb:3303:1876092510025600:0@lo:103: 00000100:00100000:3.0:1789181348.923647:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789181348.923688:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6b52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:880710ad-110c-42a4-a174-ab1b99a7ebeb:3305:1876092510025856:0@lo:103: 00000100:00100000:0.0:1789181348.923878:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6b51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:880710ad-110c-42a4-a174-ab1b99a7ebeb:3306:1876092510025472:0@lo:103: 00000100:00100000:0.0:1789181348.923885:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6b50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:880710ad-110c-42a4-a174-ab1b99a7ebeb:3306:1876092510025984:0@lo:103: 00010000:00010000:0.0:1789181348.923907:0:5837:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9dc18151ac00/0x8f4f7840b2e41020 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181348.923939:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dc18151ac00/0x8f4f7840b2e41020 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181348.923946:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc18151ac00/0x8f4f7840b2e41020 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789181348.923960:0:5837:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1789181348.986399:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189955050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+11:7632:x1876092510024704:12345-0@lo:253: Request processed in 114211us (117618us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181348.986414:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789181348.986525:0:7632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1baba5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:7632:1876092510024704:0@lo:253: 10000000:01000000:2.0:1789181348.986553:0:7632:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789181348.986556:0:7632:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789181348.986558:0:7632:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789181348.986560:0:7632:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789181348.986561:0:7632:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1789181348.986562:0:7632:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789181348.986564:0:7632:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789181348.986565:0:7632:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789181348.986567:0:7632:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1789181348.986568:0:7632:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789181348.986570:0:7632:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789181348.986587:0:7632:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9dc08132f800 from lustre-OST0001 10000000:01000000:2.0:1789181348.986626:0:7632:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1789181348.986629:0:7632:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789181348.986636:0:7632:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9dc18851cd40 local copy 10000000:01000000:2.0:1789181348.986640:0:7632:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789181348.986675:0:7632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc18151ac00/0x8f4f7840b2e41027 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181348.986685:0:7632:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.132@tcp lock: ffff9dc18151ac00/0x8f4f7840b2e41027 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181348.986694:0:7632:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.132@tcp lock: ffff9dc18151ac00/0x8f4f7840b2e41027 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181348.986711:0:7632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc18854ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:7632:1876092510026112:0@lo:101: 00000100:00100000:2.0:1789181348.986743:0:7632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181348.986780:0:7632:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1c03ce000 going to sleep for 11 seconds 00000100:00100000:1.0:1789181348.986834:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510026112 00000100:00100000:1.0:1789181348.986841:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510026112 00000100:00100000:1.0:1789181348.986886:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789181348.986895:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189955850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+11:7632:x1876092510026112:12345-0@lo:101: 00010000:00010000:1.0:1789181348.986906:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181348.986931:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc1c2045600/0x8f4f7840b2e4102e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f4f7840b2e41027 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181348.987065:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc1c2045600/0x8f4f7840b2e4102e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f4f7840b2e41027 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181348.987076:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc1c2045600/0x8f4f7840b2e4102e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e41027 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181348.987095:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1c2045600, rc 0) 00000100:00100000:1.0:1789181348.987134:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189955850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+12:7632:x1876092510026112:12345-0@lo:101: Request processed in 240us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181348.987140:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789181348.987360:0:7632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc18854ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:7632:1876092510026112:0@lo:101: 00010000:00010000:2.0:1789181348.987375:0:7632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.132@tcp lock: ffff9dc18151ac00/0x8f4f7840b2e41027 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x8f4f7840b2e4102e expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181348.987394:0:7632:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.132@tcp lock: ffff9dc18151ac00/0x8f4f7840b2e41027 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x8f4f7840b2e4102e expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181348.987488:0:7632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc18854ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:7632:1876092510026240:0@lo:501: 00000100:00100000:2.0:1789181348.987524:0:7632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181348.987542:0:7632:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1c03ce000 going to sleep for 11 seconds 00000100:00100000:1.0:1789181348.987642:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510026240 00000100:00100000:1.0:1789181348.987647:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510026240 00000100:00100000:1.0:1789181348.987677:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789181348.987685:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189957450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+12:7632:x1876092510026240:12345-0@lo:501: 00000100:00100000:1.0:1789181348.987888:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189957450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+12:7632:x1876092510026240:12345-0@lo:501: Request processed in 203us (363us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789181348.987895:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789181348.987989:0:7632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc18854ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:7632:1876092510026240:0@lo:501: 10000000:01000000:2.0:1789181348.988003:0:7632:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.132@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789181348.988027:0:7632:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.132@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789181348.988034:0:7632:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc18151ac00/0x8f4f7840b2e41027 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x8f4f7840b2e4102e expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181348.988042:0:7632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc18151ac00/0x8f4f7840b2e41027 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x8f4f7840b2e4102e expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181348.988060:0:7632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.132@tcp lock: ffff9dc18151ac00/0x8f4f7840b2e41027 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x8f4f7840b2e4102e expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181348.988081:0:7632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789181348.988099:0:7632:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9dc08132f800 10000000:01000000:2.0:1789181348.988104:0:7632:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789181348.988109:0:7632:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789181348.988112:0:7632:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789181348.988116:0:7632:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1789181348.988119:0:7632:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1789181348.988135:0:7632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc18151a800/0x8f4f7840b2e41035 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181348.988152:0:7632:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.132@tcp lock: ffff9dc18151a800/0x8f4f7840b2e41035 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181348.988161:0:7632:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.132@tcp lock: ffff9dc18151a800/0x8f4f7840b2e41035 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181348.988174:0:7632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc18854ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:7632:1876092510026368:0@lo:101: 00000100:00100000:2.0:1789181348.988355:0:7632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181348.988378:0:7632:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1c03ceb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789181348.988489:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510026368 00000100:00100000:1.0:1789181348.988494:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510026368 00000100:00100000:1.0:1789181348.988526:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789181348.988533:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189957c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+12:7632:x1876092510026368:12345-0@lo:101: 00010000:00010000:1.0:1789181348.988541:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181348.988551:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc1c2045c00/0x8f4f7840b2e4103c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f4f7840b2e41035 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181348.988567:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc1c2045c00/0x8f4f7840b2e4103c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f4f7840b2e41035 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181348.988576:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc1c2045c00/0x8f4f7840b2e4103c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e41035 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181348.988584:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1c2045c00, rc 0) 00000100:00100000:1.0:1789181348.988612:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189957c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+13:7632:x1876092510026368:12345-0@lo:101: Request processed in 79us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181348.988623:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00010000:1.0:1789181348.988645:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789181348.988651:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.132@tcp lock: ffff9dc18151ac00/0x8f4f7840b2e41027 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x8f4f7840b2e4102e expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181348.988658:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc18151ac00 already unused, calling callback (ffffffffc1b45c20) 10000000:00010000:1.0:1789181348.988662:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.132@tcp lock: ffff9dc18151ac00/0x8f4f7840b2e41027 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x8f4f7840b2e4102e expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181348.988670:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.132@tcp lock: ffff9dc18151ac00/0x8f4f7840b2e41027 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x8f4f7840b2e4102e expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789181348.988676:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.132@tcp lock: ffff9dc18151ac00/0x8f4f7840b2e41027 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x8f4f7840b2e4102e expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789181348.988681:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789181348.988699:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.132@tcp lock: ffff9dc18151ac00/0x8f4f7840b2e41027 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x8f4f7840b2e4102e expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181348.988705:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789181348.988722:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.132@tcp lock: ffff9dc18151ac00/0x8f4f7840b2e41027 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x8f4f7840b2e4102e expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181348.988728:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.132@tcp lock: ffff9dc18151ac00/0x8f4f7840b2e41027 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x8f4f7840b2e4102e expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181348.988741:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181348.988743:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181348.988744:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181348.988751:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789181348.988768:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1baba6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:880710ad-110c-42a4-a174-ab1b99a7ebeb:3304:1876092510026496:0@lo:103: 00000100:00100000:1.0:1789181348.988795:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181348.988867:0:7632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc18854ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:7632:1876092510026368:0@lo:101: 00010000:00010000:2.0:1789181348.988878:0:7632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.132@tcp lock: ffff9dc18151a800/0x8f4f7840b2e41035 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e4103c expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181348.988886:0:7632:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.132@tcp lock: ffff9dc18151a800/0x8f4f7840b2e41035 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f4f7840b2e4103c expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181348.989026:0:7632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc18854ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:7632:1876092510026624:0@lo:501: 00000100:00100000:2.0:1789181348.989066:0:7632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181348.989086:0:7632:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1c03ceb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789181348.989102:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510026624 00000100:00100000:2.0:1789181348.989106:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510026624 00000100:00100000:2.0:1789181348.989145:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789181348.989152:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189957850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+13:7632:x1876092510026624:12345-0@lo:501: 00000100:00100000:2.0:1789181348.989490:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189957850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+13:7632:x1876092510026624:12345-0@lo:501: Request processed in 338us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181348.989497:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789181348.989537:0:7632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc18854ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:7632:1876092510026624:0@lo:501: 00000100:00100000:2.0:1789181348.989562:0:7632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc18854ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:7632:1876092510026752:0@lo:503: 00000100:00100000:2.0:1789181348.989597:0:7632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181348.989617:0:7632:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1c03ceb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789181348.989629:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510026752 00000100:00100000:2.0:1789181348.989633:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510026752 00000100:00100000:2.0:1789181348.989650:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789181348.989655:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189956450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+13:7632:x1876092510026752:12345-0@lo:503: 00000100:00100000:2.0:1789181348.989791:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189956450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+13:7632:x1876092510026752:12345-0@lo:503: Request processed in 134us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181348.989801:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789181348.989840:0:7632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc18854ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:7632:1876092510026752:0@lo:503: 00000100:00100000:0.0:1789181348.990139:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510026496 00000100:00100000:0.0:1789181348.990144:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510026496 00000100:00100000:0.0:1789181348.990178:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789181348.990315:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1baba4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:880710ad-110c-42a4-a174-ab1b99a7ebeb+13:3304:x1876092510026496:12345-0@lo:103: 00010000:00010000:0.0:1789181348.990348:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789181348.990364:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc1c2045600/0x8f4f7840b2e4102e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8f4f7840b2e41027 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181348.990377:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789181348.990415:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1baba4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:880710ad-110c-42a4-a174-ab1b99a7ebeb+12:3304:x1876092510026496:12345-0@lo:103: Request processed in 231us (1618us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181348.990421:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789181348.990449:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1baba6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:880710ad-110c-42a4-a174-ab1b99a7ebeb:3304:1876092510026496:0@lo:103: 00000040:00080000:2.0:1789181348.990762:0:7632:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789181348.990846:0:7632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc18854ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:7632:1876092510026880:0@lo:502: 00000100:00100000:2.0:1789181348.990891:0:7632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181348.991080:0:7632:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1c03ceb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789181348.991098:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510026880 00000100:00100000:2.0:1789181348.991102:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510026880 00000100:00100000:1.0:1789181348.991422:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789181348.991432:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189957050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+12:7632:x1876092510026880:12345-0@lo:502: 00000100:00100000:1.0:1789181348.991613:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189957050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+12:7632:x1876092510026880:12345-0@lo:502: Request processed in 184us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181348.991621:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789181348.991707:0:7632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc18854ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:7632:1876092510026880:0@lo:502: 00000040:00080000:3.0:1789181348.991974:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1789181348.992020:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1789181348.992057:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1789181348.992098:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1789181348.992127:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1789181348.992152:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1789181348.992180:0:7632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6af1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:7632:1876092510027008:0@lo:502: 00000100:00100000:3.0:1789181348.992421:0:7632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181348.992456:0:7632:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1bfb33780 going to sleep for 11 seconds 00000100:00100000:1.0:1789181348.992549:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510027008 00000100:00100000:1.0:1789181348.992555:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510027008 00000100:00100000:1.0:1789181348.992584:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789181348.992590:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189954850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+12:7632:x1876092510027008:12345-0@lo:502: 00000100:00100000:1.0:1789181348.992727:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189954850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+12:7632:x1876092510027008:12345-0@lo:502: Request processed in 136us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181348.992734:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789181348.992802:0:7632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6af1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:7632:1876092510027008:0@lo:502: 00000040:00080000:0.0:1789181348.992883:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1789181348.992894:0:7632:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:0.0:1789181348.993500:0:7637:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789181348.993507:0:7637:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1789181348.993513:0:7637:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789181348.993515:0:7637:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1789181348.993526:0:7637:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789181348.993540:0:7637:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9dc1c1093380) 00000020:00000080:0.0:1789181348.993560:0:7637:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:0.0:1789181348.993565:0:7637:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789181348.993618:0:7637:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dc08132f800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1789181348.993625:0:7637:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789181348.993630:0:7637:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x8f4f7840b2e4104a 00010000:00010000:0.0:1789181348.998419:0:7637:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:0.0:1789181348.998742:0:7637:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:0.0:1789181349.000649:0:7637:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1789181349.000867:0:7637:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1789181349.013615:0:7637:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1789181349.014327:0:7637:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1789181349.015779:0:7637:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1789181349.015789:0:7637:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789181349.015795:0:7637:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789181349.015797:0:7637:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1789181349.015801:0:7637:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789181349.015805:0:7637:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789181349.015807:0:7637:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789181349.015810:0:7637:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789181349.015812:0:7637:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789181349.015860:0:7637:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789181349.015864:0:7637:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789181349.015865:0:7637:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789181349.015869:0:7637:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1789181349.016141:0:7632:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1789181349.016250:0:7632:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.132@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1789181349.016275:0:7632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc18151a800/0x8f4f7840b2e41035 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e4103c expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181349.016289:0:7632:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.132@tcp lock: ffff9dc18151a800/0x8f4f7840b2e41035 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e4103c expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789181349.016298:0:7632:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9dc08132f800 from 1 10000000:01000000:1.0:1789181349.016301:0:7632:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789181349.016366:0:7632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc1c2045600/0x8f4f7840b2e41051 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181349.016375:0:7632:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.132@tcp lock: ffff9dc1c2045600/0x8f4f7840b2e41051 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181349.016394:0:7632:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.132@tcp lock: ffff9dc1c2045600/0x8f4f7840b2e41051 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181349.016418:0:7632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1baba5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:7632:1876092510027136:0@lo:101: 00000100:00100000:1.0:1789181349.016485:0:7632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181349.016524:0:7632:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1b64723c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789181349.016597:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510027136 00000100:00100000:3.0:1789181349.016605:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510027136 00000100:00100000:3.0:1789181349.016652:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789181349.016662:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189956050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+12:7632:x1876092510027136:12345-0@lo:101: 00010000:00010000:3.0:1789181349.016676:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181349.016689:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc1c2175600/0x8f4f7840b2e41058 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f4f7840b2e41051 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181349.016713:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc1c2175600/0x8f4f7840b2e41058 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f4f7840b2e41051 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181349.016725:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc1c2175600/0x8f4f7840b2e41058 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e41051 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181349.016734:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1c2175600, rc 0) 00000100:00100000:3.0:1789181349.016773:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189956050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+13:7632:x1876092510027136:12345-0@lo:101: Request processed in 112us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181349.016785:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789181349.016877:0:7632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1baba5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:7632:1876092510027136:0@lo:101: 00010000:00010000:1.0:1789181349.016890:0:7632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.132@tcp lock: ffff9dc1c2045600/0x8f4f7840b2e41051 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e41058 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181349.016899:0:7632:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.132@tcp lock: ffff9dc1c2045600/0x8f4f7840b2e41051 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f4f7840b2e41058 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181349.016996:0:7632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1baba5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:7632:1876092510027264:0@lo:501: 00000100:00100000:1.0:1789181349.017021:0:7632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181349.017151:0:7632:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1b64723c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789181349.021295:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510027264 00000100:00100000:3.0:1789181349.021308:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510027264 00000100:00100000:3.0:1789181349.021516:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789181349.021529:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189956850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+13:7632:x1876092510027264:12345-0@lo:501: 00000100:00100000:3.0:1789181349.021846:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189956850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+13:7632:x1876092510027264:12345-0@lo:501: Request processed in 321us (4822us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181349.021854:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789181349.021944:0:7632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1baba5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:7632:1876092510027264:0@lo:501: 00000100:00100000:0.0:1789181349.022000:0:7632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6b50a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:7632:1876092510027392:0@lo:503: 00000100:00100000:0.0:1789181349.022043:0:7632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181349.024934:0:7632:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc189a449c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789181349.025140:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510027392 00000100:00100000:2.0:1789181349.025149:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510027392 00000100:00100000:2.0:1789181349.025192:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789181349.025202:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189977850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+13:7632:x1876092510027392:12345-0@lo:503: 00000100:00100000:2.0:1789181349.025630:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189977850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+13:7632:x1876092510027392:12345-0@lo:503: Request processed in 429us (3585us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181349.025638:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789181349.025769:0:7632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6b50a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:7632:1876092510027392:0@lo:503: 00000040:00080000:0.0:1789181349.026208:0:7632:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789181349.026280:0:7632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6b50a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:7632:1876092510027520:0@lo:502: 00000100:00100000:0.0:1789181349.026327:0:7632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181349.026379:0:7632:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc19072b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789181349.026439:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510027520 00000100:00100000:2.0:1789181349.026444:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510027520 00000100:00100000:2.0:1789181349.026473:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789181349.026480:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189977050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+13:7632:x1876092510027520:12345-0@lo:502: 00000100:00100000:2.0:1789181349.026664:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189977050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+13:7632:x1876092510027520:12345-0@lo:502: Request processed in 184us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181349.026671:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789181349.026800:0:7632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6b50a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:7632:1876092510027520:0@lo:502: 00000040:00080000:0.0:1789181349.027208:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1789181349.027260:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1789181349.027282:0:7632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6b50a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:7632:1876092510027648:0@lo:502: 00000100:00100000:0.0:1789181349.027320:0:7632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181349.027380:0:7632:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc19072b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789181349.027470:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510027648 00000100:00100000:2.0:1789181349.027475:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510027648 00000100:00100000:2.0:1789181349.027507:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789181349.027514:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189974850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+13:7632:x1876092510027648:12345-0@lo:502: 00000100:00100000:2.0:1789181349.027647:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189974850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+13:7632:x1876092510027648:12345-0@lo:502: Request processed in 133us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181349.027654:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789181349.027755:0:7632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6b50a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:7632:1876092510027648:0@lo:502: 00000040:00080000:0.0:1789181349.027839:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1789181349.027848:0:7632:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1789181349.028445:0:7641:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789181349.028455:0:7641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789181349.028457:0:7641:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789181349.028463:0:7641:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dc08132f800 00000020:00000080:2.0:1789181349.028466:0:7641:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789181349.028484:0:7641:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789181349.028487:0:7641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789181349.028489:0:7641:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1789181349.028491:0:7641:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1789181349.028629:0:7632:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1789181349.028650:0:7632:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789181349.028752:0:7632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc1c2045600/0x8f4f7840b2e41051 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e41058 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181349.028766:0:7632:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.132@tcp lock: ffff9dc1c2045600/0x8f4f7840b2e41051 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e41058 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789181349.028808:0:7632:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789181349.028811:0:7632:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9dc08132f800 10000000:01000000:0.0:1789181349.028814:0:7632:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9dc08132f800 10000000:01000000:0.0:1789181349.028818:0:7632:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789181349.028824:0:7632:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9dc08132f800 from 1 10000000:01000000:0.0:1789181349.028826:0:7632:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789181349.028853:0:7632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc180031400/0x8f4f7840b2e4105f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181349.028862:0:7632:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.132@tcp lock: ffff9dc180031400/0x8f4f7840b2e4105f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181349.028871:0:7632:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.132@tcp lock: ffff9dc180031400/0x8f4f7840b2e4105f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181349.028887:0:7632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6b50a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:7632:1876092510027776:0@lo:101: 00000100:00100000:0.0:1789181349.028937:0:7632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181349.028979:0:7632:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc19072b000 going to sleep for 11 seconds 00000100:00100000:2.0:1789181349.029148:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510027776 00000100:00100000:2.0:1789181349.029154:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510027776 00000100:00100000:2.0:1789181349.029194:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789181349.029203:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189976050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+13:7632:x1876092510027776:12345-0@lo:101: 00010000:00010000:2.0:1789181349.029212:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181349.029224:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc18151a000/0x8f4f7840b2e41066 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f4f7840b2e4105f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181349.029258:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc18151a000/0x8f4f7840b2e41066 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f4f7840b2e4105f expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181349.029269:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc18151a000/0x8f4f7840b2e41066 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e4105f expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181349.029278:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc18151a000, rc 0) 00000100:00100000:2.0:1789181349.029313:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189976050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+14:7632:x1876092510027776:12345-0@lo:101: Request processed in 112us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181349.029319:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789181349.029521:0:7632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6b50a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:7632:1876092510027776:0@lo:101: 00010000:00010000:0.0:1789181349.029535:0:7632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.132@tcp lock: ffff9dc180031400/0x8f4f7840b2e4105f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e41066 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181349.029554:0:7632:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.132@tcp lock: ffff9dc180031400/0x8f4f7840b2e4105f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f4f7840b2e41066 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181349.029647:0:7632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6b50a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:7632:1876092510027904:0@lo:501: 00000100:00100000:0.0:1789181349.029675:0:7632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181349.029705:0:7632:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc19072b000 going to sleep for 11 seconds 00000100:00100000:0.0:1789181349.029721:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510027904 00000100:00100000:0.0:1789181349.029725:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510027904 00000100:00100000:0.0:1789181349.029791:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789181349.029799:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189976850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+14:7632:x1876092510027904:12345-0@lo:501: 00000100:00100000:0.0:1789181349.030024:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189976850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+14:7632:x1876092510027904:12345-0@lo:501: Request processed in 226us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181349.030030:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789181349.030276:0:7632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6b50a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:7632:1876092510027904:0@lo:501: 00000100:00100000:0.0:1789181349.030304:0:7632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6b50a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:7632:1876092510028032:0@lo:503: 00000100:00100000:0.0:1789181349.030383:0:7632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181349.030572:0:7632:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc19072b000 going to sleep for 11 seconds 00000100:00100000:1.0:1789181349.030630:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510028032 00000100:00100000:1.0:1789181349.030636:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510028032 00000100:00100000:1.0:1789181349.030659:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789181349.030666:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189974050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+14:7632:x1876092510028032:12345-0@lo:503: 00000100:00100000:1.0:1789181349.030863:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189974050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+14:7632:x1876092510028032:12345-0@lo:503: Request processed in 196us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181349.030870:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789181349.031600:0:7632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6b50a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:7632:1876092510028032:0@lo:503: 00000040:00080000:3.0:1789181349.031922:0:7632:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789181349.032133:0:7632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6af1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:7632:1876092510028160:0@lo:502: 00000100:00100000:3.0:1789181349.032185:0:7632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181349.032268:0:7632:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1bfb33e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789181349.032308:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510028160 00000100:00100000:1.0:1789181349.032314:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510028160 00000100:00100000:1.0:1789181349.032522:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789181349.032531:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189975c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+14:7632:x1876092510028160:12345-0@lo:502: 00000100:00100000:1.0:1789181349.033565:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189975c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+14:7632:x1876092510028160:12345-0@lo:502: Request processed in 1032us (1376us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181349.033575:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789181349.033663:0:7632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6af1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:7632:1876092510028160:0@lo:502: 00000040:00080000:3.0:1789181349.033990:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1789181349.034060:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1789181349.034100:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1789181349.034161:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1789181349.034202:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1789181349.034247:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1789181349.034287:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1789181349.034323:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1789181349.034398:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1789181349.034437:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1789181349.034473:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1789181349.034519:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1789181349.034567:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1789181349.034600:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1789181349.034656:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1789181349.034691:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1789181349.034723:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1789181349.034769:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1789181349.034804:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1789181349.034836:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1789181349.034879:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1789181349.034926:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1789181349.034963:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1789181349.035012:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1789181349.035049:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1789181349.035086:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1789181349.035129:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1789181349.035164:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:3.0:1789181349.035218:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1789181349.035265:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:3.0:1789181349.035303:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:3.0:1789181349.035364:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:3.0:1789181349.035402:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:3.0:1789181349.035454:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:3.0:1789181349.035492:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:3.0:1789181349.035540:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:3.0:1789181349.035578:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:3.0:1789181349.035618:0:7632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6af1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:7632:1876092510028288:0@lo:502: 00000100:00100000:3.0:1789181349.035688:0:7632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181349.036270:0:7632:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1bfb33e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789181349.036307:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510028288 00000100:00100000:2.0:1789181349.036314:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510028288 00000100:00100000:2.0:1789181349.036496:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789181349.036505:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189974450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+14:7632:x1876092510028288:12345-0@lo:502: 00000100:00100000:2.0:1789181349.036773:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189974450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+14:7632:x1876092510028288:12345-0@lo:502: Request processed in 269us (1085us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181349.036782:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789181349.036890:0:7632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6af1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:7632:1876092510028288:0@lo:502: 00000040:00080000:3.0:1789181349.037126:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:3.0:1789181349.037139:0:7632:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:0.0:1789181349.048975:0:7642:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1789181349.048993:0:7642:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9dc1c1090000) 00000020:00000080:0.0:1789181349.049017:0:7642:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:0.0:1789181349.049128:0:7642:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dc08132f800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789181349.049132:0:7642:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dc08132f800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789181349.049135:0:7642:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dc08132f800 3 00010000:00080000:0.0:1789181349.049164:0:7642:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dc1aa5c2000@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.132@tcp at head 00010000:00010000:0.0:1789181349.052417:0:7642:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:0.0:1789181349.052691:0:7642:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1789181349.052747:0:7642:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789181349.052761:0:7642:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x8f4f7840b2e41074 00000100:00080000:0.0:1789181349.052771:0:7642:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789181349.052782:0:7642:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9dc1aa5c2000 using connection 192.168.204.132@tcp/0@lo 00000100:00100000:0.0:1789181349.052818:0:7642:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc1b6b51880 x1876092510028416/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789181349.052846:0:7642:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789181349.052959:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6b50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876092510028544:0@lo:400: 00000100:00100000:0.0:1789181349.053024:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181349.053289:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6b51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3302:1876092510028416:0@lo:38: 00000100:00100000:3.0:1789181349.053324:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181349.053403:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510028544 00000100:00100000:3.0:1789181349.053410:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510028544 00000100:00100000:3.0:1789181349.053448:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510028416 00000100:00100000:3.0:1789181349.053451:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510028416 00000100:00100000:3.0:1789181349.053468:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789181349.053477:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6b52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876092510028544:12345-0@lo:400: 00000100:00100000:3.0:1789181349.053525:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6b52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876092510028544:12345-0@lo:400: Request processed in 49us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181349.053532:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789181349.053547:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789181349.053552:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6af1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3302:x1876092510028416:12345-0@lo:38: 00010000:00080000:3.0:1789181349.053571:0:5844:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 241 last 0 00000020:00000080:3.0:1789181349.053604:0:5844:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x8f4f7840b2e4107b 00000004:00100000:3.0:1789181349.053619:0:5844:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789181349.053648:0:5844:0:(import.c:65:import_set_state_nolock()) ffff9dc1ba451800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789181349.053683:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6af1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876092510028416:12345-0@lo:38: Request processed in 130us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181349.053690:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789181349.053723:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dc1b6b51880 x1876092510028416/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789181359 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181349.053734:0:3302:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789181349.053741:0:3302:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1789181349.053747:0:3302:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789181349.053751:0:3302:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789181349.053753:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9dc1aa5c2000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789181349.053759:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6b51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3302:1876092510028416:0@lo:38: 00010000:00080000:0.0:1789181349.053836:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dc1b6b50380 x1876092510028544/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181365 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181349.053942:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6b50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876092510028544:0@lo:400: 00000100:00100000:0.0:1789181349.054027:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6b51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1876092510028672:0@lo:400: 00000100:00100000:0.0:1789181349.054120:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181349.054185:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789181349.054192:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6b50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510028800:0@lo:400: 00000100:00100000:0.0:1789181349.054218:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181349.054290:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510028800 00000100:00100000:2.0:1789181349.054295:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510028800 00000100:00100000:2.0:1789181349.054365:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789181349.054373:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6b51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510028800:12345-0@lo:400: 00000100:00100000:2.0:1789181349.054413:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6b51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510028800:12345-0@lo:400: Request processed in 41us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181349.054419:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1789181349.054436:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789181349.054457:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dc1b6b50a80 x1876092510028800/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181365 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181349.054486:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6b50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510028800:0@lo:400: 00000100:00100000:3.0:1789181349.057986:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510028672 00000100:00100000:3.0:1789181349.058009:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510028672 00000100:00100000:3.0:1789181349.058087:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789181349.058099:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6b50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876092510028672:12345-0@lo:400: 00000100:00100000:3.0:1789181349.058199:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6b50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876092510028672:12345-0@lo:400: Request processed in 103us (4078us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181349.058206:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1789181349.058441:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1789181349.058825:0:7642:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:3.0:1789181349.058935:0:7632:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1789181349.058972:0:7632:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789181349.058987:0:7632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc180031400/0x8f4f7840b2e4105f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e41066 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181349.058999:0:7632:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.132@tcp lock: ffff9dc180031400/0x8f4f7840b2e4105f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e41066 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789181349.059181:0:7632:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789181349.059184:0:7632:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789181349.059185:0:7632:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789181349.059186:0:7632:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789181349.059188:0:7632:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789181349.059190:0:7632:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789181349.059192:0:7632:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789181349.059193:0:7632:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789181349.059195:0:7632:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789181349.059196:0:7632:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789181349.059197:0:7632:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789181349.059201:0:7632:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1789181349.059203:0:7632:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789181349.059205:0:7632:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789181349.059205:0:7632:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789181349.059206:0:7632:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789181349.059207:0:7632:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789181349.059209:0:7632:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789181349.059216:0:7632:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789181349.059217:0:7632:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789181349.059218:0:7632:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789181349.059218:0:7632:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789181349.059219:0:7632:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789181349.059240:0:7632:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789181349.059256:0:7632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6af1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:7632:1876092510028928:0@lo:253: 00000100:00100000:3.0:1789181349.059309:0:7632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181349.059366:0:7632:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1bfb33e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789181349.059523:0:7644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6b50a80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7644:1876092510029056:0@lo:901: 00000100:00100000:0.0:1789181349.059573:0:7644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181349.059606:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510029056 00000100:00100000:0.0:1789181349.059612:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510029056 00000100:00100000:0.0:1789181349.059655:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789181349.059662:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c026c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7644:x1876092510029056:12345-0@lo:901: 00000100:00100000:0.0:1789181349.060222:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c026c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7644:x1876092510029056:12345-0@lo:901: Request processed in 559us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181349.060230:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1789181349.060260:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789181349.060270:0:7644:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc19072b0c0 going to sleep for 11 seconds 00010000:00080000:0.0:1789181349.060295:0:7644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dc1b6b50a80 x1876092510029056/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1789181365 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181349.060309:0:7644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6b50a80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7644:1876092510029056:0@lo:901: 00010000:00080000:2.0:1789181349.061765:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dc1b6b51c00 x1876092510028672/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181365 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181349.061781:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6b51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1876092510028672:0@lo:400: 00000100:00100000:2.0:1789181349.061815:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510028928 00000100:00100000:2.0:1789181349.061820:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510028928 00000100:00100000:2.0:1789181349.061900:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789181349.061918:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189976c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+14:7632:x1876092510028928:12345-0@lo:253: 20000000:01000000:2.0:1789181349.061956:0:5836:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1789181349.061970:0:5836:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789181349.122609:0:5836:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789181349.122634:0:5836:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1789181349.124421:0:5858:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789181349.124430:0:5858:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789181349.124459:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dc18151b000/0x8f4f7840b2e41082 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181349.124477:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dc18151b400/0x8f4f7840b2e40fd3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e40fcc expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181349.124485:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9dc18151b000/0x8f4f7840b2e41082 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181349.124526:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dc18151b400/0x8f4f7840b2e40fd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8f4f7840b2e40fcc expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181349.124541:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dc18151b400/0x8f4f7840b2e40fd3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8f4f7840b2e40fcc expref: 14 pid: 5836 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181349.124554:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc188548a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5858:1876092510029184:0@lo:104: 00000100:00100000:2.0:1789181349.124629:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181349.124690:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc188bdc600 going to sleep for 11 seconds 00000100:00100000:0.0:1789181349.125073:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510029184 00000100:00100000:0.0:1789181349.125082:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510029184 00000100:00100000:0.0:1789181349.125133:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789181349.125143:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc18854b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:880710ad-110c-42a4-a174-ab1b99a7ebeb+3:5858:x1876092510029184:12345-0@lo:104: 00010000:00010000:0.0:1789181349.125155:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.132@tcp lock: ffff9dc1c2175800/0x8f4f7840b2e40fcc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f4f7840b2e40fd3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181349.125219:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789181349.125225:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc18854b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:880710ad-110c-42a4-a174-ab1b99a7ebeb+3:5858:x1876092510029184:12345-0@lo:104: Request processed in 84us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181349.125231:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1789181349.125251:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789181349.125257:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.132@tcp lock: ffff9dc1c2175800/0x8f4f7840b2e40fcc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f4f7840b2e40fd3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181349.125264:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1c2175800 already unused, calling callback (ffffffffc1b45c20) 10000000:00010000:0.0:1789181349.125268:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.132@tcp lock: ffff9dc1c2175800/0x8f4f7840b2e40fcc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8f4f7840b2e40fd3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181349.125276:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.132@tcp lock: ffff9dc1c2175800/0x8f4f7840b2e40fcc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8f4f7840b2e40fd3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789181349.125282:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.132@tcp lock: ffff9dc1c2175800/0x8f4f7840b2e40fcc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8f4f7840b2e40fd3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789181349.125299:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789181349.125327:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.132@tcp lock: ffff9dc1c2175800/0x8f4f7840b2e40fcc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e40fd3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181349.125370:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789181349.125388:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.132@tcp lock: ffff9dc1c2175800/0x8f4f7840b2e40fcc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e40fd3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181349.125395:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.132@tcp lock: ffff9dc1c2175800/0x8f4f7840b2e40fcc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e40fd3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181349.125412:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181349.125414:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181349.125416:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181349.125428:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789181349.125439:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c026d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:880710ad-110c-42a4-a174-ab1b99a7ebeb:3304:1876092510029312:0@lo:103: 00000100:00100000:0.0:1789181349.125470:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181349.125507:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510029312 00000100:00100000:0.0:1789181349.125511:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510029312 00010000:00010000:0.0:1789181349.125528:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dc18151b400/0x8f4f7840b2e40fd3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f4f7840b2e40fcc expref: 15 pid: 5836 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181349.125547:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789181349.125554:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1960f1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:880710ad-110c-42a4-a174-ab1b99a7ebeb+15:3304:x1876092510029312:12345-0@lo:103: 00010000:00010000:0.0:1789181349.125564:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789181349.125568:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dc18151b400/0x8f4f7840b2e40fd3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f4f7840b2e40fcc expref: 15 pid: 5836 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181349.125578:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dc18151b400/0x8f4f7840b2e40fd3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8f4f7840b2e40fcc expref: 15 pid: 5836 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181349.125599:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9dc18151b000/0x8f4f7840b2e41082 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181349.125606:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc18151b000/0x8f4f7840b2e41082 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789181349.125619:0:5828:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001861554s 00010000:00010000:0.0:1789181349.125623:0:5828:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dc18151b000/0x8f4f7840b2e41082 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181349.125631:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dc18151b000/0x8f4f7840b2e41082 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181349.125638:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dc18151b000/0x8f4f7840b2e41082 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181349.125644:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dc18151b000/0x8f4f7840b2e41082 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181349.125649:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc18151b000 already unused, calling callback (ffffffffc152f9b0) 00010000:00010000:0.0:1789181349.125654:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dc18151b000/0x8f4f7840b2e41082 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181349.125664:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dc18151b000/0x8f4f7840b2e41082 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181349.125673:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dc18151b000/0x8f4f7840b2e41082 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181349.125682:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789181349.125787:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc18151b400/0x8f4f7840b2e40fd3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8f4f7840b2e40fcc expref: 15 pid: 5836 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181349.125799:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc188548a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5858:1876092510029184:0@lo:104: 00010000:00010000:2.0:1789181349.125815:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9dc18151b000/0x8f4f7840b2e41082 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181349.125824:0:5858:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9dc18151b000/0x8f4f7840b2e41082 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181349.125831:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dc18151b000/0x8f4f7840b2e41082 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181349.125837:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc18151b000/0x8f4f7840b2e41082 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181349.126149:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1960f1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:880710ad-110c-42a4-a174-ab1b99a7ebeb+14:3304:x1876092510029312:12345-0@lo:103: Request processed in 595us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181349.126163:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789181349.135585:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c026d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:880710ad-110c-42a4-a174-ab1b99a7ebeb:3304:1876092510029312:0@lo:103: 00000100:00100000:1.0:1789181349.160410:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189976c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+13:7632:x1876092510028928:12345-0@lo:253: Request processed in 98492us (101090us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181349.160426:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789181349.160616:0:7632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6af1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:880710ad-110c-42a4-a174-ab1b99a7ebeb:7632:1876092510028928:0@lo:253: 10000000:01000000:3.0:1789181349.160634:0:7632:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789181349.160638:0:7632:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789181349.160640:0:7632:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789181349.160641:0:7632:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789181349.160642:0:7632:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789181349.160644:0:7632:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789181349.160645:0:7632:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789181349.160647:0:7632:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789181349.160648:0:7632:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789181349.160650:0:7632:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789181349.160652:0:7632:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789181349.160653:0:7632:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789181349.160670:0:7632:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789181349.168547:0:7632:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1789181349.168744:0:7632:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789181349.168990:0:7632:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1789181349.169812:0:7632:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1789181349.170757:0:7632:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1789181349.171056:0:7632:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1789181349.173937:0:7632:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1789181349.427652:0:7632:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1789181349.427660:0:7632:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1789181349.427693:0:7632:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789181349.427749:0:7632:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.132@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789181349.427764:0:7632:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1789181349.427807:0:7632:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1789181349.448145:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181349.887819:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6af1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876092510029440:0@lo:13: 00000100:00100000:0.0:1789181349.887885:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181349.888344:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510029440 00000100:00100000:3.0:1789181349.888354:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510029440 00000100:00100000:3.0:1789181349.888412:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789181349.888420:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c026e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876092510029440:12345-0@lo:13: 00002000:00000024:3.0:1789181349.888464:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789181349.888522:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c026e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876092510029440:12345-0@lo:13: Request processed in 103us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181349.888529:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789181349.889223:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc1b6af1880 x1876092510029440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181365 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181349.889244:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6af1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876092510029440:0@lo:13: 00010000:00010000:0.0:1789181350.463155:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181351.488472:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181352.511659:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181353.538407:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181354.494596:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c026f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:880710ad-110c-42a4-a174-ab1b99a7ebeb:3305:1876092510029568:0@lo:400: 00000100:00100000:0.0:1789181354.494698:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181354.494755:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c026e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1876092510030080:0@lo:400: 00000100:00100000:0.0:1789181354.494787:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181354.494864:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789181354.494871:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c026c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876092510029696:0@lo:400: 00000100:00100000:0.0:1789181354.495129:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181354.495166:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c026ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1876092510029824:0@lo:400: 00000100:00100000:0.0:1789181354.495192:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181354.495209:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789181354.495215:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c026f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876092510029952:0@lo:400: 00000100:00100000:0.0:1789181354.495238:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181354.495271:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510029568 00000100:00100000:0.0:1789181354.495279:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510029568 00000100:00100000:0.0:1789181354.495324:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789181354.496289:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189974c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+13:3305:x1876092510029568:12345-0@lo:400: 00000100:00100000:0.0:1789181354.496501:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189974c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+13:3305:x1876092510029568:12345-0@lo:400: Request processed in 226us (1803us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181354.496510:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789181354.496555:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510030080 00000100:00100000:0.0:1789181354.496560:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510030080 00000100:00100000:0.0:1789181354.496616:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510029696 00000100:00100000:0.0:1789181354.496627:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510029696 00000100:00100000:0.0:1789181354.496644:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510029824 00000100:00100000:0.0:1789181354.496647:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510029824 00000100:00100000:0.0:1789181354.496660:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789181354.496666:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c026ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876092510030080:12345-0@lo:400: 00000100:00100000:0.0:1789181354.496896:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c026ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876092510030080:12345-0@lo:400: Request processed in 34us (1914us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181354.496906:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789181354.496923:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789181354.496930:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c026f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876092510029696:12345-0@lo:400: 00000100:00100000:0.0:1789181354.496965:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c026f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876092510029696:12345-0@lo:400: Request processed in 36us (1836us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181354.496971:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789181354.496986:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789181354.496993:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c026ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876092510029824:12345-0@lo:400: 00000100:00100000:0.0:1789181354.497028:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c026ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876092510029824:12345-0@lo:400: Request processed in 36us (1834us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181354.497033:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789181354.497057:0:6894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510029952 00000100:00100000:0.0:1789181354.497061:0:6894:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510029952 00000100:00100000:0.0:1789181354.497091:0:6894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789181354.497097:0:6894:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c026ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1876092510029952:12345-0@lo:400: 00000100:00100000:0.0:1789181354.497273:0:6894:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c026ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1876092510029952:12345-0@lo:400: Request processed in 176us (2032us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181354.497280:0:6894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1789181354.497298:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789181354.497303:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789181354.497629:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc1c026f100 x1876092510029952/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181370 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181354.497645:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c026f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876092510029952:0@lo:400: 00010000:00080000:3.0:1789181354.497714:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc1c026ea00 x1876092510029824/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181370 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181354.497725:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c026ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1876092510029824:0@lo:400: 00010000:00080000:3.0:1789181354.497760:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc1c026c000 x1876092510029696/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181370 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181354.497768:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c026c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876092510029696:0@lo:400: 00000100:00100000:3.0:1789181354.497776:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c026f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:880710ad-110c-42a4-a174-ab1b99a7ebeb:3305:1876092510029568:0@lo:400: 00010000:00080000:3.0:1789181354.497795:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc1c026e300 x1876092510030080/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181370 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181354.497802:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c026e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1876092510030080:0@lo:400: 00010000:00010000:3.0:1789181354.558539:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181355.011487:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789181355.011513:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6af3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510030208:0@lo:13: 00000100:00100000:2.0:1789181355.011578:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181355.011949:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510030208 00000100:00100000:3.0:1789181355.011959:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510030208 00000100:00100000:3.0:1789181355.012020:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789181355.012031:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc188548a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510030208:12345-0@lo:13: 00002000:00000024:3.0:1789181355.012063:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789181355.012113:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc188548a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510030208:12345-0@lo:13: Request processed in 85us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181355.012120:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1789181355.012160:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc1b6af3480 x1876092510030208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181371 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181355.012195:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6af3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510030208:0@lo:13: 00010000:00010000:2.0:1789181355.582552:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181356.611791:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789181356.648182:0:7986:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg432-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 10000000:01000000:0.0:1789181357.054456:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789181357.054479:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9dc189d1d800 from 30 10000000:01000000:0.0:1789181357.054485:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789181357.054533:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc180030600/0x8f4f7840b2e41089 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181357.054544:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.132@tcp lock: ffff9dc180030600/0x8f4f7840b2e41089 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181357.054555:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.132@tcp lock: ffff9dc180030600/0x8f4f7840b2e41089 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181357.054580:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c026dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510030336:0@lo:101: 00000100:00100000:0.0:1789181357.054650:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181357.054709:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc189899840 going to sleep for 11 seconds 00000100:00100000:1.0:1789181357.054811:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510030336 00000100:00100000:1.0:1789181357.054821:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510030336 00000100:00100000:1.0:1789181357.054879:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789181357.054890:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189975450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+13:5840:x1876092510030336:12345-0@lo:101: 00010000:00010000:1.0:1789181357.054904:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181357.054918:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc1c2045000/0x8f4f7840b2e41090 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f4f7840b2e41089 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181357.054943:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc1c2045000/0x8f4f7840b2e41090 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f4f7840b2e41089 expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181357.054955:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc1c2045000/0x8f4f7840b2e41090 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e41089 expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181357.054964:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1c2045000, rc 0) 00000100:00100000:1.0:1789181357.055011:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189975450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+14:5840:x1876092510030336:12345-0@lo:101: Request processed in 123us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181357.055027:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789181357.055191:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c026dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510030336:0@lo:101: 00010000:00010000:0.0:1789181357.055207:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.132@tcp lock: ffff9dc180030600/0x8f4f7840b2e41089 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e41090 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181357.055216:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.132@tcp lock: ffff9dc180030600/0x8f4f7840b2e41089 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f4f7840b2e41090 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181357.055282:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c026dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510030464:0@lo:501: 00000100:00100000:0.0:1789181357.055309:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181357.055371:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc189899840 going to sleep for 11 seconds 00000100:00100000:1.0:1789181357.055422:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510030464 00000100:00100000:1.0:1789181357.055426:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510030464 00000100:00100000:1.0:1789181357.055447:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789181357.055453:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189975050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+14:5840:x1876092510030464:12345-0@lo:501: 00000100:00100000:1.0:1789181357.055700:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189975050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+14:5840:x1876092510030464:12345-0@lo:501: Request processed in 245us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181357.055707:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789181357.055889:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c026dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510030464:0@lo:501: 00000100:00100000:0.0:1789181357.055917:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c026dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510030592:0@lo:503: 00000100:00100000:0.0:1789181357.055955:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181357.056014:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc189899840 going to sleep for 11 seconds 00000100:00100000:1.0:1789181357.057244:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510030592 00000100:00100000:1.0:1789181357.057256:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510030592 00000100:00100000:2.0:1789181357.057594:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789181357.057609:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189975850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+14:5840:x1876092510030592:12345-0@lo:503: 00000100:00100000:2.0:1789181357.057919:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189975850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+14:5840:x1876092510030592:12345-0@lo:503: Request processed in 314us (1961us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181357.057928:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789181357.058054:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c026dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510030592:0@lo:503: 00000100:00100000:1.0:1789181357.058668:0:8008:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1baba4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:880710ad-110c-42a4-a174-ab1b99a7ebeb:8008:1876092510030720:0@lo:502: 00000100:00100000:1.0:1789181357.058718:0:8008:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181357.058767:0:8008:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc083b9e840 going to sleep for 11 seconds 00000100:00100000:2.0:1789181357.058878:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510030720 00000100:00100000:2.0:1789181357.058884:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510030720 00000100:00100000:2.0:1789181357.058917:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789181357.058924:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189976450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+14:8008:x1876092510030720:12345-0@lo:502: 00000100:00100000:2.0:1789181357.061022:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189976450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+14:8008:x1876092510030720:12345-0@lo:502: Request processed in 2091us (2296us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181357.061043:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789181357.061233:0:8008:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1baba4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:880710ad-110c-42a4-a174-ab1b99a7ebeb:8008:1876092510030720:0@lo:502: 00000100:00100000:2.0:1789181357.065423:0:8008:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6af3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:880710ad-110c-42a4-a174-ab1b99a7ebeb:8008:1876092510030848:0@lo:502: 00000100:00100000:2.0:1789181357.065522:0:8008:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181357.065569:0:8008:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1879a6180 going to sleep for 11 seconds 00000100:00100000:3.0:1789181357.065633:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510030848 00000100:00100000:3.0:1789181357.065643:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510030848 00000100:00100000:3.0:1789181357.065697:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789181357.065706:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189977450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+14:8008:x1876092510030848:12345-0@lo:502: 00000100:00100000:3.0:1789181357.065976:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189977450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+14:8008:x1876092510030848:12345-0@lo:502: Request processed in 270us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181357.065985:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789181357.066142:0:8008:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6af3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:880710ad-110c-42a4-a174-ab1b99a7ebeb:8008:1876092510030848:0@lo:502: 00000040:00080000:0.0:1789181357.066178:0:8008:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1789181357.066470:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1789181357.066490:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789181357.066500:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc180030600/0x8f4f7840b2e41089 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e41090 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181357.066512:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.132@tcp lock: ffff9dc180030600/0x8f4f7840b2e41089 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e41090 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789181357.066521:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1789181357.066524:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:3.0:1789181357.066527:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789181357.066555:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc1c2174200/0x8f4f7840b2e41097 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181357.066564:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.132@tcp lock: ffff9dc1c2174200/0x8f4f7840b2e41097 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181357.066573:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.132@tcp lock: ffff9dc1c2174200/0x8f4f7840b2e41097 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181357.066594:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6af3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510030976:0@lo:101: 00000100:00100000:3.0:1789181357.066625:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181357.066722:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1c03ce840 going to sleep for 11 seconds 00000100:00100000:0.0:1789181357.066979:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510030976 00000100:00100000:0.0:1789181357.066985:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510030976 00000100:00100000:0.0:1789181357.067057:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789181357.067066:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189977c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+14:5840:x1876092510030976:12345-0@lo:101: 00010000:00010000:0.0:1789181357.067077:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181357.067089:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc180031600/0x8f4f7840b2e4109e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f4f7840b2e41097 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181357.067112:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc180031600/0x8f4f7840b2e4109e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f4f7840b2e41097 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181357.067122:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc180031600/0x8f4f7840b2e4109e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e41097 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181357.067132:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc180031600, rc 0) 00000100:00100000:0.0:1789181357.067175:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189977c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+15:5840:x1876092510030976:12345-0@lo:101: Request processed in 110us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181357.067181:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789181357.067250:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6af3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510030976:0@lo:101: 00010000:00010000:1.0:1789181357.067264:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.132@tcp lock: ffff9dc1c2174200/0x8f4f7840b2e41097 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e4109e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181357.067274:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.132@tcp lock: ffff9dc1c2174200/0x8f4f7840b2e41097 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f4f7840b2e4109e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181357.067479:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1baba5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510031104:0@lo:501: 00000100:00100000:1.0:1789181357.067509:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181357.067541:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc083b9ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789181357.067584:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510031104 00000100:00100000:0.0:1789181357.067588:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510031104 00000100:00100000:0.0:1789181357.067606:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789181357.067611:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+15:5840:x1876092510031104:12345-0@lo:501: 00000100:00100000:0.0:1789181357.067873:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+15:5840:x1876092510031104:12345-0@lo:501: Request processed in 260us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181357.067881:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789181357.068006:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1baba5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510031104:0@lo:501: 00000100:00100000:1.0:1789181357.068032:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1baba5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510031232:0@lo:503: 00000100:00100000:1.0:1789181357.068069:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181357.068096:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc083b9ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789181357.068140:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510031232 00000100:00100000:0.0:1789181357.068145:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510031232 00000100:00100000:0.0:1789181357.068162:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789181357.068168:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+15:5840:x1876092510031232:12345-0@lo:503: 00000100:00100000:0.0:1789181357.068718:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+15:5840:x1876092510031232:12345-0@lo:503: Request processed in 547us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181357.068726:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789181357.068915:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1baba5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510031232:0@lo:503: 00000100:00100000:3.0:1789181357.069644:0:8009:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6af1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:880710ad-110c-42a4-a174-ab1b99a7ebeb:8009:1876092510031360:0@lo:502: 00000100:00100000:3.0:1789181357.069697:0:8009:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181357.069734:0:8009:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1c03ced80 going to sleep for 11 seconds 00000100:00100000:2.0:1789181357.069810:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510031360 00000100:00100000:2.0:1789181357.069816:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510031360 00000100:00100000:2.0:1789181357.069867:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789181357.069876:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+15:8009:x1876092510031360:12345-0@lo:502: 00000100:00100000:2.0:1789181357.070082:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+15:8009:x1876092510031360:12345-0@lo:502: Request processed in 206us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181357.070089:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789181357.070275:0:8009:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6af1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:880710ad-110c-42a4-a174-ab1b99a7ebeb:8009:1876092510031360:0@lo:502: 00000020:01000000:3.0:1789181357.070316:0:8009:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789181357.070326:0:8009:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789181357.070347:0:8009:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789181357.070356:0:8009:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789181357.070358:0:8009:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789181357.070375:0:8009:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6af1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:880710ad-110c-42a4-a174-ab1b99a7ebeb:8009:1876092510031488:0@lo:502: 00000100:00100000:3.0:1789181357.070409:0:8009:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181357.070433:0:8009:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1c03ced80 going to sleep for 11 seconds 00000100:00100000:1.0:1789181357.070488:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510031488 00000100:00100000:1.0:1789181357.070492:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510031488 00000100:00100000:1.0:1789181357.070522:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789181357.070530:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c273050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+15:8009:x1876092510031488:12345-0@lo:502: 00000100:00100000:1.0:1789181357.070657:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c273050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+15:8009:x1876092510031488:12345-0@lo:502: Request processed in 128us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181357.070664:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789181357.070910:0:8009:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6af1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:880710ad-110c-42a4-a174-ab1b99a7ebeb:8009:1876092510031488:0@lo:502: 00000020:01000000:3.0:1789181357.070930:0:8009:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789181357.070934:0:8009:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789181357.070936:0:8009:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789181357.070940:0:8009:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:1.0:1789181357.071088:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1789181357.071107:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.132@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789181357.071117:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc1c2174200/0x8f4f7840b2e41097 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e4109e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181357.071128:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.132@tcp lock: ffff9dc1c2174200/0x8f4f7840b2e41097 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e4109e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789181357.071138:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789181357.071141:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9dc1add60800 from 30 10000000:01000000:1.0:1789181357.071144:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789181357.071169:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc1c2045800/0x8f4f7840b2e410a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181357.071176:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.132@tcp lock: ffff9dc1c2045800/0x8f4f7840b2e410a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181357.071184:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.132@tcp lock: ffff9dc1c2045800/0x8f4f7840b2e410a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181357.071197:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1baba5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510031616:0@lo:101: 00000100:00100000:1.0:1789181357.071233:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181357.071270:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc083b9e6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789181357.071365:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510031616 00000100:00100000:2.0:1789181357.071371:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510031616 00000100:00100000:2.0:1789181357.071394:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789181357.071401:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+15:5840:x1876092510031616:12345-0@lo:101: 00010000:00010000:2.0:1789181357.071411:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181357.071424:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc18151b400/0x8f4f7840b2e410ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f4f7840b2e410a5 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181357.071444:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc18151b400/0x8f4f7840b2e410ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f4f7840b2e410a5 expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181357.071454:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc18151b400/0x8f4f7840b2e410ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e410a5 expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181357.071461:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc18151b400, rc 0) 00000100:00100000:2.0:1789181357.071491:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+16:5840:x1876092510031616:12345-0@lo:101: Request processed in 90us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181357.071496:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789181357.071571:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1baba5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510031616:0@lo:101: 00010000:00010000:1.0:1789181357.071584:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.132@tcp lock: ffff9dc1c2045800/0x8f4f7840b2e410a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e410ac expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181357.071593:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.132@tcp lock: ffff9dc1c2045800/0x8f4f7840b2e410a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f4f7840b2e410ac expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181357.071631:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1baba5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510031744:0@lo:501: 00000100:00100000:1.0:1789181357.071654:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181357.071677:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc083b9e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789181357.071744:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510031744 00000100:00100000:3.0:1789181357.071748:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510031744 00000100:00100000:3.0:1789181357.071780:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789181357.071788:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+16:5840:x1876092510031744:12345-0@lo:501: 00000100:00100000:3.0:1789181357.072126:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+16:5840:x1876092510031744:12345-0@lo:501: Request processed in 338us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181357.072142:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789181357.072212:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1baba5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510031744:0@lo:501: 00000100:00100000:1.0:1789181357.072237:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1baba5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510031872:0@lo:503: 00000100:00100000:1.0:1789181357.072271:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181357.072292:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc083b9e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789181357.072354:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510031872 00000100:00100000:3.0:1789181357.072358:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510031872 00000100:00100000:3.0:1789181357.072452:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789181357.072460:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+16:5840:x1876092510031872:12345-0@lo:503: 00000100:00100000:3.0:1789181357.072591:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+16:5840:x1876092510031872:12345-0@lo:503: Request processed in 132us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181357.072598:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789181357.072961:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1baba5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510031872:0@lo:503: 00000100:00100000:1.0:1789181357.073815:0:8010:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1baba5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:880710ad-110c-42a4-a174-ab1b99a7ebeb:8010:1876092510032000:0@lo:502: 00000100:00100000:1.0:1789181357.073868:0:8010:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181357.073934:0:8010:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc083b9ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1789181357.074068:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510032000 00000100:00100000:3.0:1789181357.074074:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510032000 00000100:00100000:1.0:1789181357.074197:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789181357.074205:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c270050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+16:8010:x1876092510032000:12345-0@lo:502: 00000100:00100000:1.0:1789181357.074459:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c270050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+16:8010:x1876092510032000:12345-0@lo:502: Request processed in 254us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181357.074467:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789181357.074552:0:8010:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1baba5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:880710ad-110c-42a4-a174-ab1b99a7ebeb:8010:1876092510032000:0@lo:502: 00000100:00100000:3.0:1789181357.074603:0:8010:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6af1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:880710ad-110c-42a4-a174-ab1b99a7ebeb:8010:1876092510032128:0@lo:502: 00000100:00100000:3.0:1789181357.074635:0:8010:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181357.074925:0:8010:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1c03ce9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789181357.074976:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510032128 00000100:00100000:2.0:1789181357.074982:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510032128 00000100:00100000:2.0:1789181357.075007:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789181357.075013:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c270450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+16:8010:x1876092510032128:12345-0@lo:502: 00000100:00100000:2.0:1789181357.075165:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c270450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+16:8010:x1876092510032128:12345-0@lo:502: Request processed in 151us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181357.075180:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789181357.075257:0:8010:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6af1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:880710ad-110c-42a4-a174-ab1b99a7ebeb:8010:1876092510032128:0@lo:502: 00000040:00080000:3.0:1789181357.075278:0:8010:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1789181357.075498:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1789181357.075514:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789181357.075524:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc1c2045800/0x8f4f7840b2e410a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e410ac expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181357.075535:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.132@tcp lock: ffff9dc1c2045800/0x8f4f7840b2e410a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e410ac expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789181357.075545:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789181357.075547:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9dc1add60800 from 5 10000000:01000000:2.0:1789181357.075550:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789181357.075575:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc18151be00/0x8f4f7840b2e410b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181357.075584:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.132@tcp lock: ffff9dc18151be00/0x8f4f7840b2e410b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181357.075593:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.132@tcp lock: ffff9dc18151be00/0x8f4f7840b2e410b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181357.075607:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc188548e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510032256:0@lo:101: 00000100:00100000:2.0:1789181357.075635:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181357.075663:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1879a6900 going to sleep for 11 seconds 00000100:00100000:3.0:1789181357.075708:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510032256 00000100:00100000:3.0:1789181357.075713:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510032256 00000100:00100000:3.0:1789181357.075734:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789181357.075740:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c271c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+16:5840:x1876092510032256:12345-0@lo:101: 00010000:00010000:3.0:1789181357.075749:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181357.075772:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc1c2175a00/0x8f4f7840b2e410ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f4f7840b2e410b3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181357.075858:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc1c2175a00/0x8f4f7840b2e410ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f4f7840b2e410b3 expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181357.075879:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc1c2175a00/0x8f4f7840b2e410ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e410b3 expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181357.075888:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1c2175a00, rc 0) 00000100:00100000:3.0:1789181357.075964:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c271c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+17:5840:x1876092510032256:12345-0@lo:101: Request processed in 223us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181357.075970:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789181357.076111:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc188548e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510032256:0@lo:101: 00010000:00010000:2.0:1789181357.076123:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.132@tcp lock: ffff9dc18151be00/0x8f4f7840b2e410b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e410ba expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181357.076133:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.132@tcp lock: ffff9dc18151be00/0x8f4f7840b2e410b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f4f7840b2e410ba expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181357.076182:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc188548e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510032384:0@lo:256: 00000100:00100000:2.0:1789181357.076211:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181357.076232:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1879a6900 going to sleep for 11 seconds 00000100:00100000:3.0:1789181357.076279:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510032384 00000100:00100000:3.0:1789181357.076283:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510032384 00000100:00100000:3.0:1789181357.076412:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789181357.076420:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c272c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+17:5840:x1876092510032384:12345-0@lo:256: 20000000:01000000:3.0:1789181357.076433:0:5836:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789181357.076449:0:5836:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789181357.076452:0:5836:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1789181357.076515:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c272c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+17:5840:x1876092510032384:12345-0@lo:256: Request processed in 96us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181357.076522:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789181357.076611:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc188548e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510032384:0@lo:256: 10000000:01000000:2.0:1789181357.076649:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789181357.076655:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc18151be00/0x8f4f7840b2e410b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e410ba expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181357.076664:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.132@tcp lock: ffff9dc18151be00/0x8f4f7840b2e410b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e410ba expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789181357.076671:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789181357.076673:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1789181357.076676:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789181357.076692:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc18151a600/0x8f4f7840b2e410c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181357.076698:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.132@tcp lock: ffff9dc18151a600/0x8f4f7840b2e410c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181357.076706:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.132@tcp lock: ffff9dc18151a600/0x8f4f7840b2e410c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181357.076718:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc188548e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510032512:0@lo:101: 00000100:00100000:2.0:1789181357.076743:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181357.076940:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1879a6900 going to sleep for 11 seconds 00000100:00100000:1.0:1789181357.077000:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510032512 00000100:00100000:1.0:1789181357.077005:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510032512 00000100:00100000:1.0:1789181357.077033:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789181357.077039:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+17:5840:x1876092510032512:12345-0@lo:101: 00010000:00010000:1.0:1789181357.077047:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181357.077057:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc1c2044600/0x8f4f7840b2e410c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f4f7840b2e410c1 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181357.077072:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc1c2044600/0x8f4f7840b2e410c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f4f7840b2e410c1 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181357.077084:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc1c2044600/0x8f4f7840b2e410c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e410c1 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181357.077091:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1c2044600, rc 0) 00000100:00100000:1.0:1789181357.077138:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+18:5840:x1876092510032512:12345-0@lo:101: Request processed in 99us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181357.077143:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789181357.077227:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc188548e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510032512:0@lo:101: 00010000:00010000:2.0:1789181357.077245:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.132@tcp lock: ffff9dc18151a600/0x8f4f7840b2e410c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e410c8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181357.077251:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.132@tcp lock: ffff9dc18151a600/0x8f4f7840b2e410c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f4f7840b2e410c8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181357.077290:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc188548e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510032640:0@lo:501: 00000100:00100000:2.0:1789181357.077314:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181357.077362:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1879a6900 going to sleep for 11 seconds 00000100:00100000:1.0:1789181357.077416:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510032640 00000100:00100000:1.0:1789181357.077420:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510032640 00000100:00100000:1.0:1789181357.077437:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789181357.077444:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+18:5840:x1876092510032640:12345-0@lo:501: 00000100:00100000:1.0:1789181357.077681:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+18:5840:x1876092510032640:12345-0@lo:501: Request processed in 237us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181357.077689:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789181357.077922:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc188548e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510032640:0@lo:501: 00000100:00100000:2.0:1789181357.077949:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc188548e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510032768:0@lo:503: 00000100:00100000:2.0:1789181357.077985:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181357.078004:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1879a6900 going to sleep for 11 seconds 00000100:00100000:1.0:1789181357.078054:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510032768 00000100:00100000:1.0:1789181357.078058:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510032768 00000100:00100000:1.0:1789181357.078087:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789181357.078093:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+18:5840:x1876092510032768:12345-0@lo:503: 00000100:00100000:1.0:1789181357.078417:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+18:5840:x1876092510032768:12345-0@lo:503: Request processed in 323us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181357.078431:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789181357.078654:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc188548e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510032768:0@lo:503: 00000100:00100000:0.0:1789181357.079075:0:8011:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c026dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:880710ad-110c-42a4-a174-ab1b99a7ebeb:8011:1876092510032896:0@lo:502: 00000100:00100000:0.0:1789181357.079115:0:8011:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181357.079180:0:8011:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1898999c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789181357.079212:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510032896 00000100:00100000:3.0:1789181357.079217:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510032896 00000100:00100000:3.0:1789181357.079283:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789181357.079292:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+18:8011:x1876092510032896:12345-0@lo:502: 00000100:00100000:3.0:1789181357.079583:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+18:8011:x1876092510032896:12345-0@lo:502: Request processed in 292us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181357.079591:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789181357.079689:0:8011:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c026dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:880710ad-110c-42a4-a174-ab1b99a7ebeb:8011:1876092510032896:0@lo:502: 00000020:01000000:0.0:1789181357.079718:0:8011:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789181357.079725:0:8011:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1789181357.079732:0:8011:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789181357.079734:0:8011:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1789181357.079739:0:8011:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789181357.079743:0:8011:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.132@tcp to nid 0x20000c0a8cc84 (192.168.204.132@tcp) 00000020:01000000:0.0:1789181357.079775:0:8011:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1789181357.079778:0:8011:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789181357.080104:0:8011:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9dc189d14d40) 00000020:00000080:0.0:1789181357.080127:0:8011:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1789181357.080134:0:8011:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789181357.080202:0:8011:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1789181357.080208:0:8011:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:0.0:1789181357.080213:0:8011:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8f4f7840b2e410d6 00010000:00080000:0.0:1789181357.080240:0:8011:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dc1bfb98800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.132@tcp at head 00010000:00010000:0.0:1789181357.080494:0:8011:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:0.0:1789181357.080910:0:8011:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1789181357.080928:0:8011:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1789181357.081576:0:8011:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789181357.081832:0:8011:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789181357.081887:0:8011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1789181357.081944:0:8011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1789181357.086222:0:8012:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789181357.086230:0:8012:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1789181357.086948:0:8011:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789181357.086959:0:8011:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789181357.086991:0:8011:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1789181357.087013:0:8011:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8f4f7840b2e410dd 00000100:00080000:2.0:1789181357.087023:0:8011:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789181357.087034:0:8011:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9dc1bfb98800 using connection 192.168.204.132@tcp/0@lo 00000100:00100000:2.0:1789181357.087067:0:8011:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc188548e00 x1876092510033024/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789181357.087096:0:8011:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1789181357.087200:0:8011:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789181357.087209:0:8011:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789181357.087211:0:8011:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1789181357.087214:0:8011:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789181357.087218:0:8011:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789181357.087219:0:8011:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789181357.087223:0:8011:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789181357.087225:0:8011:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789181357.087250:0:8011:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc188548380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:880710ad-110c-42a4-a174-ab1b99a7ebeb:8011:1876092510033664:0@lo:502: 00000100:00100000:2.0:1789181357.087322:0:8011:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181357.087425:0:8011:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1879a6300 going to sleep for 11 seconds 00000100:00100000:1.0:1789181357.088061:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc188548e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1876092510033024:0@lo:8: 00000100:00100000:1.0:1789181357.088104:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181357.088157:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc188549f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1876092510033536:0@lo:400: 00000100:00100000:1.0:1789181357.088188:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181357.088210:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789181357.088215:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc188549880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876092510033408:0@lo:400: 00000100:00100000:1.0:1789181357.088235:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181357.088265:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510033664 00000100:00100000:1.0:1789181357.088272:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510033664 00000100:00100000:1.0:1789181357.088314:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789181357.088322:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+18:8011:x1876092510033664:12345-0@lo:502: 00000100:00100000:1.0:1789181357.088586:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+18:8011:x1876092510033664:12345-0@lo:502: Request processed in 264us (1263us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181357.088594:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789181357.088635:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510033024 00000100:00100000:1.0:1789181357.088639:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510033024 00000100:00100000:1.0:1789181357.088656:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510033408 00000100:00100000:1.0:1789181357.088659:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510033408 00000100:00100000:1.0:1789181357.088689:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789181357.088695:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1baba4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876092510033408:12345-0@lo:400: 00000100:00100000:1.0:1789181357.088732:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1baba4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876092510033408:12345-0@lo:400: Request processed in 36us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181357.088737:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789181357.088749:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789181357.088753:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1baba4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3302:x1876092510033024:12345-0@lo:8: 00010000:00080000:1.0:1789181357.088797:0:6693:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 249 last 0 00000020:00000080:1.0:1789181357.088825:0:6693:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8f4f7840b2e410e4 00002000:00100000:1.0:1789181357.088837:0:6693:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9dc1babb2000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1789181357.088841:0:6693:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:1.0:1789181357.088845:0:6693:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1789181357.088953:0:6693:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789181357.089107:0:6693:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789181357.089144:0:6693:0:(import.c:65:import_set_state_nolock()) ffff9dc1b671e000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789181357.089185:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1baba4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3302:x1876092510033024:12345-0@lo:8: Request processed in 430us (1080us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181357.089192:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1789181357.089228:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc188549880 x1876092510033408/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181373 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181357.089241:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc188549880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876092510033408:0@lo:400: 00010000:00080000:1.0:1789181357.089271:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc188548e00 x1876092510033024/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789181367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181357.089279:0:3302:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789181357.089285:0:3302:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1789181357.089292:0:3302:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789181357.089297:0:3302:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1789181357.089299:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9dc1bfb98800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789181357.089306:0:3302:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789181357.089310:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc188548e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1876092510033024:0@lo:8: 00000004:00080000:2.0:1789181357.089686:0:8012:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789181357.089802:0:8012:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 249346470117ns, next at 0ns, rc = 0 00000100:00100000:2.0:1789181357.089836:0:8011:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc188548380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:880710ad-110c-42a4-a174-ab1b99a7ebeb:8011:1876092510033664:0@lo:502: 00000020:01000000:2.0:1789181357.089871:0:8011:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789181357.089877:0:8011:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789181357.089879:0:8011:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789181357.089883:0:8011:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:2.0:1789181357.089941:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1789181357.089959:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.132@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789181357.089968:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc18151a600/0x8f4f7840b2e410c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e410c8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181357.089980:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.132@tcp lock: ffff9dc18151a600/0x8f4f7840b2e410c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e410c8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789181357.089991:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1789181357.089994:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9dc18851cd40 from 1 10000000:01000000:2.0:1789181357.089996:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789181357.090022:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc18151aa00/0x8f4f7840b2e410eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181357.090041:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.132@tcp lock: ffff9dc18151aa00/0x8f4f7840b2e410eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181357.090051:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.132@tcp lock: ffff9dc18151aa00/0x8f4f7840b2e410eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181357.090067:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc188548380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510033792:0@lo:101: 00000100:00100000:2.0:1789181357.090108:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181357.090126:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1879a6300 going to sleep for 11 seconds 00000100:00100000:3.0:1789181357.090455:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc18854a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876092510033152:0@lo:400: 00000100:00100000:3.0:1789181357.090489:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181357.090523:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789181357.090530:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc18854ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1876092510033280:0@lo:400: 00000100:00100000:3.0:1789181357.090552:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181357.091104:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510033536 00000100:00100000:3.0:1789181357.091111:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510033536 00000100:00100000:3.0:1789181357.091153:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510033152 00000100:00100000:3.0:1789181357.091156:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510033152 00000100:00100000:3.0:1789181357.091168:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510033280 00000100:00100000:3.0:1789181357.091170:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510033280 00000100:00100000:3.0:1789181357.091184:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789181357.091192:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1baba6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876092510033536:12345-0@lo:400: 00000100:00100000:3.0:1789181357.091284:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1baba6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876092510033536:12345-0@lo:400: Request processed in 91us (3095us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181357.091291:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789181357.091308:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789181357.091314:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6af1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876092510033152:12345-0@lo:400: 00000100:00100000:3.0:1789181357.091376:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6af1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876092510033152:12345-0@lo:400: Request processed in 62us (885us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181357.091383:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789181357.091394:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789181357.091400:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6af0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876092510033280:12345-0@lo:400: 00000100:00100000:3.0:1789181357.091423:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6af0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876092510033280:12345-0@lo:400: Request processed in 24us (871us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181357.091428:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1789181357.091461:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc18854ad80 x1876092510033280/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181373 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181357.091473:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc18854ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1876092510033280:0@lo:400: 00010000:00080000:3.0:1789181357.091497:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc18854a300 x1876092510033152/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181373 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181357.091505:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc18854a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876092510033152:0@lo:400: 00010000:00080000:3.0:1789181357.091536:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc188549f80 x1876092510033536/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181373 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181357.091546:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc188549f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1876092510033536:0@lo:400: 00000100:00100000:3.0:1789181357.091561:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510033792 00000100:00100000:3.0:1789181357.091564:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510033792 00000100:00100000:3.0:1789181357.091591:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789181357.091597:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c371c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+18:5840:x1876092510033792:12345-0@lo:101: 00010000:00010000:3.0:1789181357.091606:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181357.091622:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc1c2175800/0x8f4f7840b2e410f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f4f7840b2e410eb expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181357.091646:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc1c2175800/0x8f4f7840b2e410f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f4f7840b2e410eb expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181357.091657:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc1c2175800/0x8f4f7840b2e410f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e410eb expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181357.091667:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1c2175800, rc 0) 00000100:00100000:3.0:1789181357.091697:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c371c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:5840:x1876092510033792:12345-0@lo:101: Request processed in 100us (1589us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181357.091703:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789181357.091734:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc188548380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510033792:0@lo:101: 00010000:00010000:3.0:1789181357.091749:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.132@tcp lock: ffff9dc18151aa00/0x8f4f7840b2e410eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e410f2 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181357.091783:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.132@tcp lock: ffff9dc18151aa00/0x8f4f7840b2e410eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f4f7840b2e410f2 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789181357.093463:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789181357.093471:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789181357.099571:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6af2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510033920:0@lo:501: 00000100:00100000:3.0:1789181357.099640:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181357.099682:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc184cb30c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789181357.099703:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510033920 00000100:00100000:3.0:1789181357.099710:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510033920 00000100:00100000:3.0:1789181357.099751:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789181357.099775:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c370450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:5840:x1876092510033920:12345-0@lo:501: 00000100:00100000:3.0:1789181357.099981:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c370450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:5840:x1876092510033920:12345-0@lo:501: Request processed in 222us (340us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789181357.099990:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789181357.100036:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6af2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510033920:0@lo:501: 10000000:01000000:3.0:1789181357.104004:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.132@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789181357.104022:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc18151aa00/0x8f4f7840b2e410eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e410f2 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181357.104034:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.132@tcp lock: ffff9dc18151aa00/0x8f4f7840b2e410eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e410f2 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789181357.174511:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:0.0:1789181357.174585:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c026dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876092510034048:0@lo:13: 00000100:00100000:0.0:1789181357.174857:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1789181357.174937:0:8013:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:0.0:1789181357.174960:0:8013:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c026c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8013:1876092510034176:0@lo:7: 00000100:00100000:0.0:1789181357.174987:0:8013:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181357.175010:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510034176 00000100:00100000:0.0:1789181357.175017:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510034176 00000100:00100000:0.0:1789181357.175068:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789181357.175078:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c026df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8013:x1876092510034176:12345-0@lo:7: 00000100:00080000:1.0:1789181357.179003:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789181357.179030:0:8013:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1960f8540 going to sleep for 11 seconds 00000100:00100000:3.0:1789181357.181513:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510034048 00000100:00100000:3.0:1789181357.181525:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510034048 00000100:00100000:3.0:1789181357.182132:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789181357.182144:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c026fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1876092510034048:12345-0@lo:13: 00002000:00000024:3.0:1789181357.182180:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1789181357.182277:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c026fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1876092510034048:12345-0@lo:13: Request processed in 136us (7420us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181357.182284:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1789181357.185365:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc1c026dc00 x1876092510034048/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181373 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181357.185391:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c026dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876092510034048:0@lo:13: 00002000:00080000:0.0:1789181357.187698:0:6693:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:0.0:1789181357.187705:0:6693:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:0.0:1789181357.187821:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c026df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8013:x1876092510034176:12345-0@lo:7: Request processed in 12741us (12829us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181357.187832:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1789181357.187898:0:8013:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc1c026c380 x1876092510034176/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789181373 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181357.187912:0:8013:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c026c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8013:1876092510034176:0@lo:7: 00000004:00080000:0.0:1789181357.187933:0:8013:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1789181357.187974:0:8013:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c026c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8013:1876092510034304:0@lo:5: 00000100:00100000:0.0:1789181357.188003:0:8013:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181357.188030:0:6894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510034304 00000100:00100000:0.0:1789181357.188036:0:6894:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510034304 00000100:00100000:0.0:1789181357.188068:0:6894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789181357.188075:0:6894:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c026dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8013:x1876092510034304:12345-0@lo:5: 00002000:00080000:0.0:1789181357.188096:0:6894:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1789181357.188100:0:6894:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1789181357.189258:0:6894:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c026dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:8013:x1876092510034304:12345-0@lo:5: Request processed in 1180us (1251us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1789181357.189267:0:6894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789181357.189302:0:8013:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc08311db40 going to sleep for 11 seconds 00010000:00080000:0.0:1789181357.189346:0:8013:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc1c026c380 x1876092510034304/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789181373 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181357.189359:0:8013:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c026c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8013:1876092510034304:0@lo:5: 00000004:00080000:0.0:1789181357.189370:0:8013:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1789181357.189395:0:8013:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c026d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8013:1876092510034432:0@lo:700: 00000100:00100000:0.0:1789181357.189416:0:8013:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181357.189439:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510034432 00000100:00100000:0.0:1789181357.189443:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510034432 00000100:00100000:0.0:1789181357.189470:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789181357.189476:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c026d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8013:x1876092510034432:12345-0@lo:700: 00000100:00100000:0.0:1789181357.189502:0:6700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c026e300 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6700:1876092510034560:0@lo:700: 00000100:00100000:0.0:1789181357.189524:0:6700:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181357.189547:0:6700:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc08311de40 going to sleep for 11 seconds 00000100:00100000:0.0:1789181357.189561:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510034560 00000100:00100000:0.0:1789181357.189564:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510034560 00000100:00100000:0.0:1789181357.189586:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789181357.189591:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c026f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6700:x1876092510034560:12345-0@lo:700: 00000100:00100000:0.0:1789181357.191093:0:8013:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc08311db40 going to sleep for 11 seconds 40000000:02000000:1.0:1789181357.245238:0:5849:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:3.0:1789181357.258849:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c026f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6700:x1876092510034560:12345-0@lo:700: Request processed in 69251us (69317us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181357.258864:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789181357.258894:0:6700:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc1c026e300 x1876092510034560/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789181373 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181357.258912:0:6700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c026e300 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6700:1876092510034560:0@lo:700: 40000000:02000000:1.0:1789181357.258926:0:6700:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:2.0:1789181357.317853:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:2.0:1789181357.317879:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1789181357.318598:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c026d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8013:x1876092510034432:12345-0@lo:700: Request processed in 129115us (129174us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181357.318610:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789181357.318853:0:8013:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc1c026d880 x1876092510034432/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789181373 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181357.318865:0:8013:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1789181357.318880:0:8013:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c026d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8013:1876092510034432:0@lo:700: 00000004:02000040:0.0:1789181357.356060:0:8013:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:0.0:1789181357.361170:0:8013:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c026d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8013:1876092510034688:0@lo:5: 00000100:00100000:0.0:1789181357.361239:0:8013:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181357.361382:0:8013:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc08311d6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789181357.361932:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510034688 00000100:00100000:2.0:1789181357.361942:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510034688 00000100:00100000:2.0:1789181357.362031:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789181357.362042:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c026c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8013:x1876092510034688:12345-0@lo:5: 00002000:00080000:2.0:1789181357.370574:0:6692:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1789181357.370597:0:6692:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1789181357.376380:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c026c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8013:x1876092510034688:12345-0@lo:5: Request processed in 14335us (15135us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1789181357.376393:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1789181357.376468:0:8013:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc1c026d880 x1876092510034688/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789181373 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181357.376487:0:8013:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c026d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8013:1876092510034688:0@lo:5: 00000004:00080000:0.0:1789181357.376501:0:8013:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:2.0:1789181357.632571:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181358.654671:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181359.678646:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181360.128752:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789181360.128778:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6af2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876092510034816:0@lo:13: 00000100:00100000:1.0:1789181360.128855:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181360.129245:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510034816 00000100:00100000:3.0:1789181360.129255:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510034816 00000100:00100000:3.0:1789181360.129322:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789181360.129355:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1baba5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876092510034816:12345-0@lo:13: 00002000:00000024:3.0:1789181360.129392:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789181360.129451:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1baba5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876092510034816:12345-0@lo:13: Request processed in 120us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181360.129458:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1789181360.137832:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789181360.137904:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc1b6af2a00 x1876092510034816/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181376 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181360.137930:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6af2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876092510034816:0@lo:13: 00010000:00010000:1.0:1789181360.710708:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181361.741492:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181362.174971:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc18854b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876092510035072:0@lo:400: 00000100:00100000:2.0:1789181362.175036:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181362.175084:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc188548380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876092510035584:0@lo:400: 00000100:00100000:2.0:1789181362.175112:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181362.175140:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789181362.175145:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc18854bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:880710ad-110c-42a4-a174-ab1b99a7ebeb:3306:1876092510034944:0@lo:400: 00000100:00100000:2.0:1789181362.175170:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181362.175189:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc188548000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1876092510035456:0@lo:400: 00000100:00100000:2.0:1789181362.175229:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181362.175263:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510035072 00000100:00100000:2.0:1789181362.175271:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510035072 00000100:00100000:2.0:1789181362.175310:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510035456 00000100:00100000:2.0:1789181362.175313:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510035456 00000100:00100000:2.0:1789181362.175359:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789181362.175368:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc188549f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876092510035072:12345-0@lo:400: 00000100:00100000:2.0:1789181362.175417:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc188549f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876092510035072:12345-0@lo:400: Request processed in 50us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181362.175424:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789181362.175439:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789181362.175445:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc18854ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876092510035456:12345-0@lo:400: 00000100:00100000:2.0:1789181362.175472:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc18854ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876092510035456:12345-0@lo:400: Request processed in 28us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181362.175478:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789181362.175496:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510034944 00000100:00100000:2.0:1789181362.175499:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510034944 00000100:00100000:2.0:1789181362.175524:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789181362.175531:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c372c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:3306:x1876092510034944:12345-0@lo:400: 00000100:00100000:2.0:1789181362.175559:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c372c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:3306:x1876092510034944:12345-0@lo:400: Request processed in 29us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181362.175564:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789181362.175607:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc18854bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:880710ad-110c-42a4-a174-ab1b99a7ebeb:3306:1876092510034944:0@lo:400: 00010000:00080000:2.0:1789181362.175619:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc188548000 x1876092510035456/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181378 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181362.175629:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc188548000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1876092510035456:0@lo:400: 00010000:00080000:2.0:1789181362.175648:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc18854b480 x1876092510035072/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181378 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181362.175657:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc18854b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876092510035072:0@lo:400: 00000100:00100000:1.0:1789181362.176404:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc188549c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1876092510035200:0@lo:400: 00000100:00100000:1.0:1789181362.176450:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181362.176479:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789181362.176486:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc188548700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876092510035328:0@lo:400: 00000100:00100000:1.0:1789181362.176508:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789181362.176533:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789181362.176547:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510035200 00000100:00100000:1.0:1789181362.176552:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510035200 00000100:00100000:1.0:1789181362.176587:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789181362.176594:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1baba6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876092510035200:12345-0@lo:400: 00000100:00100000:1.0:1789181362.176645:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1baba6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876092510035200:12345-0@lo:400: Request processed in 52us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181362.176652:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789181362.176684:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510035584 00000100:00100000:1.0:1789181362.176687:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510035584 00000100:00100000:1.0:1789181362.176711:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510035328 00000100:00100000:1.0:1789181362.176714:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510035328 00000100:00100000:1.0:1789181362.176734:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789181362.176740:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc18854a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1876092510035584:12345-0@lo:400: 00000100:00100000:1.0:1789181362.176776:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc18854a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1876092510035584:12345-0@lo:400: Request processed in 36us (1663us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181362.176782:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789181362.176793:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789181362.176799:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1baba5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1876092510035328:12345-0@lo:400: 00000100:00100000:1.0:1789181362.176826:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1baba5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1876092510035328:12345-0@lo:400: Request processed in 27us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181362.176831:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1789181362.176868:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc188548380 x1876092510035584/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181378 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181362.176881:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc188548380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876092510035584:0@lo:400: 00000100:00080000:1.0:1789181362.176901:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789181362.176904:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789181362.176906:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789181362.176920:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc188548700 x1876092510035328/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181378 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181362.176927:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc188548700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876092510035328:0@lo:400: 00010000:00080000:1.0:1789181362.176946:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc188549c00 x1876092510035200/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181378 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181362.176955:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc188549c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1876092510035200:0@lo:400: 00000001:00080000:2.0:1789181362.354025:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:1.0:1789181362.692536:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c026c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876092510035712:0@lo:13: 00000100:00100000:1.0:1789181362.692639:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181362.693316:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510035712 00000100:00100000:2.0:1789181362.693343:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510035712 00000100:00100000:2.0:1789181362.693399:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789181362.693410:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1baba7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876092510035712:12345-0@lo:13: 00002000:00000024:2.0:1789181362.693450:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789181362.693519:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1baba7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876092510035712:12345-0@lo:13: Request processed in 110us (879us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181362.693526:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1789181362.696815:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc1c026c000 x1876092510035712/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181378 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181362.696832:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1789181362.696860:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c026c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876092510035712:0@lo:13: 00010000:00010000:1.0:1789181362.750590:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181363.101482:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181363.101718:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092487991424 00000100:00100000:3.0:1789181363.101728:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092487991424 00000100:00100000:3.0:1789181363.101773:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 112 00000100:00100000:3.0:1789181363.101782:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c370c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2350:x1876092487991424:12345-192.168.204.32@tcp:250: 00010000:00080000:3.0:1789181363.101809:0:5835:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 975a0591-a8f7-4a74-9f93-a5aa77f2315c@192.168.204.32@tcp t0 exp 0000000000000000 cur 255 last 0 00000020:00000080:3.0:1789181363.101948:0:5835:0:(genops.c:1384:class_connect()) connect: client 975a0591-a8f7-4a74-9f93-a5aa77f2315c, cookie 0x8f4f7840b2e410f9 00000100:00080000:3.0:1789181363.102132:0:5835:0:(import.c:65:import_set_state_nolock()) ffff9dc1ba457000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789181363.102403:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c370c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:975a0591-a8f7-4a74-9f93-a5aa77f2315c+5:2350:x1876092487991424:12345-192.168.204.32@tcp:250: Request processed in 620us (930us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181363.102411:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 112 00000100:00100000:3.0:1789181363.118424:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181363.118584:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092487991552 00000100:00100000:2.0:1789181363.118595:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092487991552 00000100:00100000:2.0:1789181363.118654:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 113 00000100:00100000:2.0:1789181363.118666:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c371450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:975a0591-a8f7-4a74-9f93-a5aa77f2315c+5:5580:x1876092487991552:12345-192.168.204.32@tcp:101: 00010000:00010000:2.0:1789181363.118694:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181363.118713:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc18151ac00/0x8f4f7840b2e41100 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91eef8 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181363.118745:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc18151ac00/0x8f4f7840b2e41100 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91eef8 expref: 6 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181363.118767:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc18151ac00/0x8f4f7840b2e41100 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91eef8 expref: 6 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181363.118777:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc18151ac00, rc 0) 00000100:00100000:2.0:1789181363.118862:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c371450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:975a0591-a8f7-4a74-9f93-a5aa77f2315c+6:5580:x1876092487991552:12345-192.168.204.32@tcp:101: Request processed in 198us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181363.118870:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 113 00000100:00100000:0.0:1789181363.135041:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181363.135783:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092487991680 00000100:00100000:3.0:1789181363.135797:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092487991680 00000100:00100000:3.0:1789181363.135873:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 114 00000100:00100000:3.0:1789181363.135885:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c371050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:975a0591-a8f7-4a74-9f93-a5aa77f2315c+6:5580:x1876092487991680:12345-192.168.204.32@tcp:501: 00000100:00100000:3.0:1789181363.136258:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c371050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:975a0591-a8f7-4a74-9f93-a5aa77f2315c+6:5580:x1876092487991680:12345-192.168.204.32@tcp:501: Request processed in 375us (1228us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789181363.136267:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 114 00000100:00100000:3.0:1789181363.138617:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181363.138776:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092487991808 00000100:00100000:0.0:1789181363.138785:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092487991808 00000100:00100000:0.0:1789181363.138848:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 115 00000100:00100000:0.0:1789181363.138859:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c371850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:975a0591-a8f7-4a74-9f93-a5aa77f2315c+6:5580:x1876092487991808:12345-192.168.204.32@tcp:101: 00010000:00010000:0.0:1789181363.138875:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181363.138910:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc180030200/0x8f4f7840b2e41107 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91eeff expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181363.138944:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc180030200/0x8f4f7840b2e41107 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91eeff expref: 7 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181363.138957:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc180030200/0x8f4f7840b2e41107 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91eeff expref: 7 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181363.138968:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc180030200, rc 0) 00000100:00100000:0.0:1789181363.139031:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c371850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:975a0591-a8f7-4a74-9f93-a5aa77f2315c+7:5580:x1876092487991808:12345-192.168.204.32@tcp:101: Request processed in 173us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181363.139038:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 115 00000100:00100000:3.0:1789181363.142669:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181363.142884:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092487991936 00000100:00100000:0.0:1789181363.142911:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092487991936 00000100:00100000:0.0:1789181363.142976:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 116 00000100:00100000:0.0:1789181363.142987:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c372450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:975a0591-a8f7-4a74-9f93-a5aa77f2315c+7:5580:x1876092487991936:12345-192.168.204.32@tcp:501: 00000100:00100000:0.0:1789181363.143454:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c372450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:975a0591-a8f7-4a74-9f93-a5aa77f2315c+8:5580:x1876092487991936:12345-192.168.204.32@tcp:501: Request processed in 466us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181363.143462:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 116 00000100:00100000:0.0:1789181363.145622:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181363.150964:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092487992064 00000100:00100000:2.0:1789181363.150978:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092487992064 00000100:00100000:2.0:1789181363.151042:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 117 00000100:00100000:2.0:1789181363.151052:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c373450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:975a0591-a8f7-4a74-9f93-a5aa77f2315c+8:5580:x1876092487992064:12345-192.168.204.32@tcp:503: 00000100:00100000:2.0:1789181363.151554:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c373450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:975a0591-a8f7-4a74-9f93-a5aa77f2315c+8:5580:x1876092487992064:12345-192.168.204.32@tcp:503: Request processed in 501us (5938us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181363.151562:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 117 00000100:00100000:0.0:1789181363.164402:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181363.164534:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092487992192 00000100:00100000:2.0:1789181363.164547:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092487992192 00000100:00100000:2.0:1789181363.164600:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 118 00000100:00100000:2.0:1789181363.164611:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c373c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:975a0591-a8f7-4a74-9f93-a5aa77f2315c+8:5598:x1876092487992192:12345-192.168.204.32@tcp:502: 00000100:00100000:3.0:1789181363.166052:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c373c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:975a0591-a8f7-4a74-9f93-a5aa77f2315c+8:5598:x1876092487992192:12345-192.168.204.32@tcp:502: Request processed in 1435us (1653us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181363.166065:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 118 00000100:00100000:0.0:1789181363.220999:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181363.221213:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092487992320 00000100:00100000:1.0:1789181363.221224:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092487992320 00000100:00100000:1.0:1789181363.221279:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 119 00000100:00100000:1.0:1789181363.221289:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c373850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:975a0591-a8f7-4a74-9f93-a5aa77f2315c+8:5598:x1876092487992320:12345-192.168.204.32@tcp:502: 00000100:00100000:1.0:1789181363.221579:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c373850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:975a0591-a8f7-4a74-9f93-a5aa77f2315c+8:5598:x1876092487992320:12345-192.168.204.32@tcp:502: Request processed in 291us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181363.221587:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 119 00000100:00100000:2.0:1789181363.235393:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181363.235433:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092487992448 00000100:00100000:2.0:1789181363.235444:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092487992448 00000100:00100000:2.0:1789181363.235495:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 120 00000100:00100000:2.0:1789181363.235506:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c373050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:975a0591-a8f7-4a74-9f93-a5aa77f2315c+8:5580:x1876092487992448:12345-192.168.204.32@tcp:101: 00010000:00010000:2.0:1789181363.235525:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181363.235547:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc18151b000/0x8f4f7840b2e4110e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91ef29 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181363.235576:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc18151b000/0x8f4f7840b2e4110e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91ef29 expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181363.235590:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc18151b000/0x8f4f7840b2e4110e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91ef29 expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181363.235614:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc18151b000, rc 0) 00000100:00100000:2.0:1789181363.235689:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c373050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:975a0591-a8f7-4a74-9f93-a5aa77f2315c+9:5580:x1876092487992448:12345-192.168.204.32@tcp:101: Request processed in 185us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181363.235696:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 120 00000100:00100000:1.0:1789181363.239092:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181363.239363:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092487992576 00000100:00100000:2.0:1789181363.239374:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092487992576 00000100:00100000:2.0:1789181363.239436:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 121 00000100:00100000:2.0:1789181363.239446:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c370850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:975a0591-a8f7-4a74-9f93-a5aa77f2315c+9:5580:x1876092487992576:12345-192.168.204.32@tcp:256: 20000000:01000000:2.0:1789181363.239474:0:5835:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789181363.239501:0:5835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789181363.239505:0:5835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789181363.239509:0:5835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789181363.239511:0:5835:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1789181363.244253:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c370850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:975a0591-a8f7-4a74-9f93-a5aa77f2315c+9:5580:x1876092487992576:12345-192.168.204.32@tcp:256: Request processed in 4793us (5156us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181363.244272:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 121 00000100:00100000:2.0:1789181363.256205:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181363.256726:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092487992704 00000100:00100000:0.0:1789181363.256738:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092487992704 00000100:00100000:0.0:1789181363.256806:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 122 00000100:00100000:0.0:1789181363.256819:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c372050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:975a0591-a8f7-4a74-9f93-a5aa77f2315c+9:5580:x1876092487992704:12345-192.168.204.32@tcp:101: 00010000:00010000:0.0:1789181363.256839:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181363.256875:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc180031c00/0x8f4f7840b2e41115 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91ef30 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181363.256909:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc180031c00/0x8f4f7840b2e41115 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91ef30 expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181363.256923:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc180031c00/0x8f4f7840b2e41115 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91ef30 expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181363.256933:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc180031c00, rc 0) 00000100:00100000:0.0:1789181363.256993:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c372050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:975a0591-a8f7-4a74-9f93-a5aa77f2315c+10:5580:x1876092487992704:12345-192.168.204.32@tcp:101: Request processed in 178us (801us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181363.257000:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 122 00000100:00100000:3.0:1789181363.261011:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181363.261278:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092487992832 00000100:00100000:2.0:1789181363.261288:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092487992832 00000100:00100000:2.0:1789181363.261362:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 123 00000100:00100000:2.0:1789181363.261374:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c372850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:975a0591-a8f7-4a74-9f93-a5aa77f2315c+10:5580:x1876092487992832:12345-192.168.204.32@tcp:501: 00000100:00100000:2.0:1789181363.261652:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c372850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:975a0591-a8f7-4a74-9f93-a5aa77f2315c+10:5580:x1876092487992832:12345-192.168.204.32@tcp:501: Request processed in 270us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181363.261661:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 123 00000100:00100000:0.0:1789181363.265489:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181363.265965:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092487992960 00000100:00100000:2.0:1789181363.265986:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092487992960 00000100:00100000:2.0:1789181363.266047:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 124 00000100:00100000:2.0:1789181363.266058:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c370050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:975a0591-a8f7-4a74-9f93-a5aa77f2315c+10:5580:x1876092487992960:12345-192.168.204.32@tcp:503: 00000100:00100000:2.0:1789181363.266705:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c370050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:975a0591-a8f7-4a74-9f93-a5aa77f2315c+10:5580:x1876092487992960:12345-192.168.204.32@tcp:503: Request processed in 646us (1221us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181363.266715:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 124 00000100:00100000:0.0:1789181363.282774:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181363.282916:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092487993088 00000100:00100000:2.0:1789181363.282926:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092487993088 00000100:00100000:2.0:1789181363.282979:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 125 00000100:00100000:2.0:1789181363.282989:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc18683f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:975a0591-a8f7-4a74-9f93-a5aa77f2315c+10:5603:x1876092487993088:12345-192.168.204.32@tcp:502: 00000100:00100000:2.0:1789181363.283270:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc18683f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:975a0591-a8f7-4a74-9f93-a5aa77f2315c+10:5603:x1876092487993088:12345-192.168.204.32@tcp:502: Request processed in 282us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181363.283279:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 125 00000100:00100000:0.0:1789181363.287715:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181363.287884:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092487993216 00000100:00100000:3.0:1789181363.287894:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092487993216 00000100:00100000:3.0:1789181363.287949:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 126 00000100:00100000:3.0:1789181363.287960:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc18683f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:975a0591-a8f7-4a74-9f93-a5aa77f2315c+10:5603:x1876092487993216:12345-192.168.204.32@tcp:502: 00000100:00100000:3.0:1789181363.288193:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc18683f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:975a0591-a8f7-4a74-9f93-a5aa77f2315c+10:5603:x1876092487993216:12345-192.168.204.32@tcp:502: Request processed in 234us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181363.288213:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 126 00000100:00100000:0.0:1789181363.291762:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181363.291939:0:6887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092487993344 00000100:00100000:3.0:1789181363.291950:0:6887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092487993344 00000100:00100000:3.0:1789181363.292003:0:6887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 4 00000100:00100000:3.0:1789181363.292012:0:6887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c026ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2350:x1876092487993344:12345-192.168.204.32@tcp:38: 00010000:00080000:3.0:1789181363.292042:0:6887:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 5971a429-48ca-4c07-88a3-fa58102a53bc@192.168.204.32@tcp t0 exp 0000000000000000 cur 255 last 0 00000020:00000080:3.0:1789181363.292123:0:6887:0:(genops.c:1384:class_connect()) connect: client 5971a429-48ca-4c07-88a3-fa58102a53bc, cookie 0x8f4f7840b2e4111c 00000004:00100000:3.0:1789181363.292156:0:6887:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1789181363.292162:0:6887:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:1.0:1789181363.321494:0:6887:0:(import.c:65:import_set_state_nolock()) ffff9dc1b671a800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789181363.321567:0:6887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c026ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+6:2350:x1876092487993344:12345-192.168.204.32@tcp:38: Request processed in 29555us (29830us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181363.321578:0:6887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 4 00010000:00010000:0.0:1789181363.775362:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181364.337795:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181364.337835:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181364.338156:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092487993600 00000100:00100000:1.0:1789181364.338168:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092487993600 00000100:00080000:3.0:1789181364.338299:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789181364.338374:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092487993472 00000100:00100000:1.0:1789181364.338390:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092487993472 00000100:00100000:0.0:1789181364.344278:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 5 00000100:00100000:0.0:1789181364.344305:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c026f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+7:5580:x1876092487993600:12345-192.168.204.32@tcp:41: 00000004:00000024:0.0:1789181364.344369:0:5842:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789181364.344465:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c026f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+7:5580:x1876092487993600:12345-192.168.204.32@tcp:41: Request processed in 173us (6679us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181364.344473:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 5 00000100:00100000:0.0:1789181364.344509:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 6 00000100:00100000:0.0:1789181364.344517:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c026d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+6:0:x1876092487993472:12345-192.168.204.32@tcp:41: 00000004:00000024:0.0:1789181364.344547:0:5842:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789181364.344570:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c026d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+6:0:x1876092487993472:12345-192.168.204.32@tcp:41: Request processed in 54us (6734us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181364.344576:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 6 00000100:00100000:1.0:1789181364.347049:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181364.349798:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092487993728 00000100:00100000:0.0:1789181364.349817:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092487993728 00000100:00100000:0.0:1789181364.349894:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 7 00000100:00100000:0.0:1789181364.349907:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1baba7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+6:5580:x1876092487993728:12345-192.168.204.32@tcp:40: 00000100:00100000:0.0:1789181364.350025:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1baba7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+6:5580:x1876092487993728:12345-192.168.204.32@tcp:40: Request processed in 121us (2985us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181364.350032:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 7 00000100:00100000:3.0:1789181364.367502:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181364.367551:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181364.367579:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181364.367630:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181364.368030:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092487993856 00000100:00100000:2.0:1789181364.368042:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092487993856 00000100:00100000:2.0:1789181364.368085:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092487993984 00000100:00100000:2.0:1789181364.368088:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092487993984 00000100:00100000:2.0:1789181364.368108:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 8 00000100:00100000:2.0:1789181364.368118:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6af0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2350:x1876092487993856:12345-192.168.204.32@tcp:8: 00010000:00080000:2.0:1789181364.368154:0:6693:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 5971a429-48ca-4c07-88a3-fa58102a53bc@192.168.204.32@tcp t0 exp 0000000000000000 cur 256 last 0 00000020:00000080:2.0:1789181364.368202:0:6693:0:(genops.c:1384:class_connect()) connect: client 5971a429-48ca-4c07-88a3-fa58102a53bc, cookie 0x8f4f7840b2e41123 00002000:00100000:2.0:1789181364.368214:0:6693:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 5971a429-48ca-4c07-88a3-fa58102a53bc/ffff9dc1878b0800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789181364.368240:0:6693:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789181364.368646:0:6693:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789181364.368741:0:6693:0:(import.c:65:import_set_state_nolock()) ffff9dc1878b6000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789181364.368808:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6af0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+6:2350:x1876092487993856:12345-192.168.204.32@tcp:8: Request processed in 690us (1255us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181364.368831:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 8 00000100:00100000:2.0:1789181364.368856:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9 00000100:00100000:2.0:1789181364.368860:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6af2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2350:x1876092487993984:12345-192.168.204.32@tcp:8: 00010000:00080000:2.0:1789181364.368877:0:6693:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 5971a429-48ca-4c07-88a3-fa58102a53bc@192.168.204.32@tcp t0 exp 0000000000000000 cur 256 last 0 00000020:00000080:2.0:1789181364.368899:0:6693:0:(genops.c:1384:class_connect()) connect: client 5971a429-48ca-4c07-88a3-fa58102a53bc, cookie 0x8f4f7840b2e4112a 00002000:00100000:2.0:1789181364.368905:0:6693:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 5971a429-48ca-4c07-88a3-fa58102a53bc/ffff9dc1aa5c2800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789181364.368920:0:6693:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:0.0:1789181364.369991:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092487994112 00000100:00100000:0.0:1789181364.370001:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092487994112 00000100:00100000:0.0:1789181364.370053:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 0 00000100:00100000:0.0:1789181364.370063:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6af0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+6:5580:x1876092487994112:12345-192.168.204.32@tcp:33: 00000100:00100000:0.0:1789181364.370149:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092487994240 00000100:00100000:0.0:1789181364.370154:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092487994240 00000100:00100000:0.0:1789181364.370195:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 127 00000100:00100000:0.0:1789181364.370206:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc18683c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:975a0591-a8f7-4a74-9f93-a5aa77f2315c+10:2353:x1876092487994240:12345-192.168.204.32@tcp:400: 00000100:00100000:0.0:1789181364.370260:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc18683c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:975a0591-a8f7-4a74-9f93-a5aa77f2315c+10:2353:x1876092487994240:12345-192.168.204.32@tcp:400: Request processed in 55us (2640us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181364.370266:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 127 00002000:00080000:2.0:1789181364.372534:0:6693:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789181364.372584:0:6693:0:(import.c:65:import_set_state_nolock()) ffff9dc1aa5c5000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789181364.372654:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6af2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+6:2350:x1876092487993984:12345-192.168.204.32@tcp:8: Request processed in 3790us (5072us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181364.372830:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9 00000004:00080000:0.0:1789181364.405126:0:5845:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 34998us 00000004:00200000:3.0:1789181364.433784:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1789181364.433914:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6af0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+6:5580:x1876092487994112:12345-192.168.204.32@tcp:33: Request processed in 63845us (66417us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181364.433929:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 0 00000100:00100000:1.0:1789181364.657631:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181364.657806:0:6887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092487994368 00000100:00100000:3.0:1789181364.657816:0:6887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092487994368 00000100:00100000:3.0:1789181364.657872:0:6887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 8 00000100:00100000:3.0:1789181364.657881:0:6887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1baba5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+6:5620:x1876092487994368:12345-192.168.204.32@tcp:101: 00010000:00010000:3.0:1789181364.657901:0:6887:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181364.657923:0:6887:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e000/0x8f4f7840b2e41131 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91ef5a expref: -99 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181364.657981:0:6887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f600/0x8f4f7840b2e41138 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181364.657995:0:6887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f600/0x8f4f7840b2e41138 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181364.658009:0:6887:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f600/0x8f4f7840b2e41138 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789181364.658067:0:6887:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789181364.658071:0:6887:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789181364.658088:0:6887:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f600/0x8f4f7840b2e41138 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181364.658125:0:6887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e000/0x8f4f7840b2e41131 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91ef5a expref: 8 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181364.658145:0:6887:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f600/0x8f4f7840b2e41138 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91ef5a expref: 7 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181364.658154:0:6887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc192187800) 00010000:00010000:3.0:1789181364.658156:0:6887:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789181364.658160:0:6887:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1bfa1f600, rc 0) 00000100:00100000:3.0:1789181364.658221:0:6887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1baba5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+7:5620:x1876092487994368:12345-192.168.204.32@tcp:101: Request processed in 341us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181364.658228:0:6887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 8 00010000:00010000:1.0:1789181364.805188:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181365.249507:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6af2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876092510035840:0@lo:13: 00000100:00100000:1.0:1789181365.249575:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181365.249755:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510035840 00000100:00100000:3.0:1789181365.249763:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510035840 00000100:00080000:1.0:1789181365.249937:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789181365.256692:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789181365.256713:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1baba4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876092510035840:12345-0@lo:13: 00002000:00000024:3.0:1789181365.256743:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789181365.256896:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1baba4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876092510035840:12345-0@lo:13: Request processed in 192us (7320us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181365.256903:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1789181365.262466:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc1b6af2a00 x1876092510035840/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181381 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181365.262498:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6af2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876092510035840:0@lo:13: 00010000:00010000:0.0:1789181365.822700:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181366.847401:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181367.042020:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181367.042439:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092487994496 00000100:00100000:0.0:1789181367.042464:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092487994496 00000100:00100000:0.0:1789181367.042586:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9 00000100:00100000:0.0:1789181367.042600:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc18854b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+7:5673:x1876092487994496:12345-192.168.204.32@tcp:41: 00000100:00080000:1.0:1789181367.042703:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:0.0:1789181367.043011:0:5842:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789181367.043094:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc18854b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+7:5673:x1876092487994496:12345-192.168.204.32@tcp:41: Request processed in 497us (1083us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181367.043102:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9 00000100:00100000:1.0:1789181367.060293:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181367.063060:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092487994624 00000100:00100000:3.0:1789181367.063250:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092487994624 00000100:00100000:3.0:1789181367.063492:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9 00000100:00100000:3.0:1789181367.063505:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1baba5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5971a429-48ca-4c07-88a3-fa58102a53bc+6:5673:x1876092487994624:12345-192.168.204.32@tcp:13: 00002000:00000024:3.0:1789181367.063544:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789181367.063647:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1baba5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5971a429-48ca-4c07-88a3-fa58102a53bc+6:5673:x1876092487994624:12345-192.168.204.32@tcp:13: Request processed in 146us (3370us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181367.063654:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9 00000100:00100000:3.0:1789181367.066997:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181367.067312:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092487994752 00000100:00100000:2.0:1789181367.067323:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092487994752 00000100:00080000:1.0:1789181367.067487:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789181367.067492:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789181367.067744:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 10 00000100:00100000:2.0:1789181367.067762:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6af3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5971a429-48ca-4c07-88a3-fa58102a53bc+6:5673:x1876092487994752:12345-192.168.204.32@tcp:13: 00002000:00000024:2.0:1789181367.067807:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789181367.067882:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6af3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5971a429-48ca-4c07-88a3-fa58102a53bc+6:5673:x1876092487994752:12345-192.168.204.32@tcp:13: Request processed in 125us (893us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181367.067889:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 10 00000100:00100000:2.0:1789181367.296716:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc188548e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1876092510036224:0@lo:400: 00000100:00100000:0.0:1789181367.296725:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc188549880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876092510036352:0@lo:400: 00000100:00100000:1.0:1789181367.296832:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc188548000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:880710ad-110c-42a4-a174-ab1b99a7ebeb:3305:1876092510035968:0@lo:400: 00000100:00100000:3.0:1789181367.296876:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc18854bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876092510036096:0@lo:400: 00000100:00100000:2.0:1789181367.299968:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181367.300070:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510036224 00000100:00100000:2.0:1789181367.300090:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510036224 00000100:00100000:2.0:1789181367.300716:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789181367.300727:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc188548380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876092510036224:12345-0@lo:400: 00000100:00100000:2.0:1789181367.300915:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc188548380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876092510036224:12345-0@lo:400: Request processed in 189us (953us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181367.300922:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789181367.300968:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc188548e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1876092510036224:0@lo:400: 00000100:00080000:2.0:1789181367.301014:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789181367.306813:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181367.309216:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181367.309270:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510035968 00000100:00100000:1.0:1789181367.309272:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc188549c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1876092510036480:0@lo:400: 00000100:00100000:0.0:1789181367.309281:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510035968 00000100:00100000:1.0:1789181367.309318:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181367.309365:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789181367.309378:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189956c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:3305:x1876092510035968:12345-0@lo:400: 00000100:00100000:1.0:1789181367.309402:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510036480 00000100:00100000:1.0:1789181367.309407:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510036480 00000100:00100000:1.0:1789181367.309456:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789181367.309461:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189956c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:3305:x1876092510035968:12345-0@lo:400: Request processed in 85us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181367.309467:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1baba7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876092510036480:12345-0@lo:400: 00000100:00100000:0.0:1789181367.309473:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1789181367.309512:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1baba7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876092510036480:12345-0@lo:400: Request processed in 47us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181367.309519:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789181367.309545:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc188548000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:880710ad-110c-42a4-a174-ab1b99a7ebeb:3305:1876092510035968:0@lo:400: 00000100:00080000:1.0:1789181367.309553:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789181367.309573:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc188549c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1876092510036480:0@lo:400: 00000100:00100000:3.0:1789181367.311545:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181367.311614:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc188548700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876092510036608:0@lo:400: 00000100:00100000:2.0:1789181367.311805:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510036352 00000100:00100000:2.0:1789181367.311814:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510036352 00000100:00100000:3.0:1789181367.311831:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181367.311876:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510036608 00000100:00100000:2.0:1789181367.311880:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510036608 00000100:00100000:3.0:1789181367.311898:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789181367.311915:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c026c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876092510036352:12345-0@lo:400: 00000100:00080000:1.0:1789181367.311949:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789181367.311961:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789181367.311974:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c026c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876092510036352:12345-0@lo:400: Request processed in 66us (5275us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181367.312033:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510036096 00000100:00100000:0.0:1789181367.312038:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510036096 00000100:00100000:0.0:1789181367.312069:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789181367.312076:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6af3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876092510036096:12345-0@lo:400: 00000100:00100000:0.0:1789181367.312115:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6af3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876092510036096:12345-0@lo:400: Request processed in 40us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181367.312501:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1789181367.312577:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc188549880 x1876092510036352/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181383 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181367.312600:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc188549880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876092510036352:0@lo:400: 00000100:00100000:2.0:1789181367.313368:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789181367.313395:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6af1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876092510036608:12345-0@lo:400: 00000100:00100000:2.0:1789181367.313452:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6af1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876092510036608:12345-0@lo:400: Request processed in 64us (1622us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181367.313459:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789181367.313553:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc18854bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876092510036096:0@lo:400: 00010000:00080000:1.0:1789181367.313579:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc188548700 x1876092510036608/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181383 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181367.313589:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc188548700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876092510036608:0@lo:400: 00000100:00100000:3.0:1789181367.327803:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789181367.806944:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789181367.806974:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c026d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876092510036736:0@lo:13: 00000100:00100000:3.0:1789181367.807050:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181367.807375:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510036736 00000100:00100000:0.0:1789181367.807384:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510036736 00000100:00100000:0.0:1789181367.807440:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789181367.807450:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6af2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876092510036736:12345-0@lo:13: 00002000:00000024:0.0:1789181367.807476:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789181367.807530:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6af2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876092510036736:12345-0@lo:13: Request processed in 82us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181367.807537:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1789181367.807771:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc1c026d880 x1876092510036736/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181383 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181367.807791:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c026d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876092510036736:0@lo:13: 00010000:00010000:1.0:1789181367.871103:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789181368.409467:0:5865:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5971a429-48ca-4c07-88a3-fa58102a53bc 00010000:00010000:2.0:1789181368.896169:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789181368.909397:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5971a429-48ca-4c07-88a3-fa58102a53bc 00000100:00100000:0.0:1789181369.432613:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181369.432664:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181369.432695:0:6894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092487995136 00000100:00100000:0.0:1789181369.432705:0:6894:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092487995136 00000100:00100000:0.0:1789181369.434924:0:6894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9 00000100:00100000:0.0:1789181369.434947:0:6894:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c026e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+6:2354:x1876092487995136:12345-192.168.204.32@tcp:400: 00000100:00100000:0.0:1789181369.435035:0:6894:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c026e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+6:2354:x1876092487995136:12345-192.168.204.32@tcp:400: Request processed in 100us (2369us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181369.435043:0:6894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9 00000100:00080000:0.0:1789181369.435077:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789181369.435613:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181369.435642:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181369.435674:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092487995264 00000100:00100000:3.0:1789181369.435681:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092487995264 00000100:00100000:3.0:1789181369.435722:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 10 00000100:00100000:3.0:1789181369.435731:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c36f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+5:2354:x1876092487995264:12345-192.168.204.32@tcp:400: 00000100:00100000:3.0:1789181369.436188:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c36f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+5:2354:x1876092487995264:12345-192.168.204.32@tcp:400: Request processed in 458us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181369.436197:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 10 00000100:00100000:1.0:1789181369.436476:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092487994880 00000100:00100000:1.0:1789181369.436482:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092487994880 00000100:00100000:1.0:1789181369.436535:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 129 00000100:00100000:1.0:1789181369.436544:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189954c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:975a0591-a8f7-4a74-9f93-a5aa77f2315c+10:2354:x1876092487994880:12345-192.168.204.32@tcp:400: 00000100:00100000:1.0:1789181369.436581:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189954c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:975a0591-a8f7-4a74-9f93-a5aa77f2315c+10:2354:x1876092487994880:12345-192.168.204.32@tcp:400: Request processed in 38us (3979us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181369.436588:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 129 00000100:00080000:2.0:1789181369.438610:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789181369.438640:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092487995008 00000100:00100000:2.0:1789181369.438652:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092487995008 00000100:00100000:2.0:1789181369.438722:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 23 00000100:00100000:2.0:1789181369.438733:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c36ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+6:2354:x1876092487995008:12345-192.168.204.32@tcp:400: 00000100:00100000:2.0:1789181369.438806:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c36ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+6:2354:x1876092487995008:12345-192.168.204.32@tcp:400: Request processed in 76us (3194us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181369.438814:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 23 00000100:00080000:3.0:1789181369.439359:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:1.0:1789181369.448738:0:6718:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5971a429-48ca-4c07-88a3-fa58102a53bc 00010000:00010000:1.0:1789181369.929194:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789181370.343921:0:8303:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1789181370.366520:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789181370.366552:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1baba5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876092510036864:0@lo:13: 00000100:00100000:1.0:1789181370.366646:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181370.366734:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510036864 00000100:00100000:1.0:1789181370.366742:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510036864 00000100:00100000:1.0:1789181370.366805:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789181370.366815:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfcf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876092510036864:12345-0@lo:13: 00002000:00000024:1.0:1789181370.366849:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789181370.366894:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfcf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876092510036864:12345-0@lo:13: Request processed in 81us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181370.366901:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1789181370.366951:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc1baba5180 x1876092510036864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181386 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181370.366970:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1baba5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876092510036864:0@lo:13: 00000100:00080000:3.0:1789181370.377657:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789181370.942678:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181371.967634:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181372.414699:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc188548700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876092510037120:0@lo:400: 00000100:00100000:2.0:1789181372.414786:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181372.414842:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc188548000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876092510037632:0@lo:400: 00000100:00100000:2.0:1789181372.414870:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181372.414899:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789181372.414905:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc188548e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:880710ad-110c-42a4-a174-ab1b99a7ebeb:3306:1876092510036992:0@lo:400: 00000100:00100000:2.0:1789181372.414932:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181372.414951:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc188549c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1876092510037504:0@lo:400: 00000100:00100000:2.0:1789181372.414971:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181372.414995:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc18854bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1876092510037248:0@lo:400: 00000100:00100000:2.0:1789181372.415016:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181372.415032:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789181372.415037:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc188549880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876092510037376:0@lo:400: 00000100:00100000:2.0:1789181372.415057:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181372.415085:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510037120 00000100:00100000:2.0:1789181372.415093:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510037120 00000100:00100000:2.0:1789181372.415132:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510037504 00000100:00100000:2.0:1789181372.415135:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510037504 00000100:00100000:2.0:1789181372.415158:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510037248 00000100:00100000:2.0:1789181372.415161:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510037248 00000100:00100000:2.0:1789181372.415178:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789181372.415187:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b66f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876092510037120:12345-0@lo:400: 00000100:00100000:2.0:1789181372.415240:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b66f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876092510037120:12345-0@lo:400: Request processed in 54us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181372.415247:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789181372.415264:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789181372.415269:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b66f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876092510037504:12345-0@lo:400: 00000100:00100000:2.0:1789181372.415306:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b66f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876092510037504:12345-0@lo:400: Request processed in 37us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181372.415312:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789181372.415324:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789181372.415366:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b66f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876092510037248:12345-0@lo:400: 00000100:00100000:2.0:1789181372.415399:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b66f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876092510037248:12345-0@lo:400: Request processed in 69us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181372.415405:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:2.0:1789181372.415424:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789181372.415458:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc18854bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1876092510037248:0@lo:400: 00000100:00100000:2.0:1789181372.415496:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc188549c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1876092510037504:0@lo:400: 00000100:00100000:2.0:1789181372.415575:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc188548700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876092510037120:0@lo:400: 00000100:00100000:0.0:1789181372.415724:0:6894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510037632 00000100:00100000:0.0:1789181372.415728:0:6894:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510037632 00000100:00100000:0.0:1789181372.415762:0:6894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510037376 00000100:00100000:0.0:1789181372.415765:0:6894:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510037376 00000100:00100000:0.0:1789181372.415786:0:6894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789181372.415793:0:6894:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b66f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1876092510037632:12345-0@lo:400: 00000100:00100000:0.0:1789181372.415840:0:6894:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b66f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1876092510037632:12345-0@lo:400: Request processed in 48us (969us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181372.415848:0:6894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789181372.415861:0:6894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789181372.415867:0:6894:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b66f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1876092510037376:12345-0@lo:400: 00000100:00100000:0.0:1789181372.415898:0:6894:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b66f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1876092510037376:12345-0@lo:400: Request processed in 31us (839us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181372.415903:0:6894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789181372.415921:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510036992 00000100:00100000:0.0:1789181372.415924:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510036992 00000100:00100000:0.0:1789181372.415949:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1789181372.415955:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189955450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:3306:x1876092510036992:12345-0@lo:400: 00000100:00100000:0.0:1789181372.415984:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189955450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:3306:x1876092510036992:12345-0@lo:400: Request processed in 29us (1051us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181372.415989:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:0.0:1789181372.416027:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789181372.416030:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789181372.416048:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc188549880 x1876092510037376/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181388 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181372.416059:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc188549880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876092510037376:0@lo:400: 00000100:00100000:0.0:1789181372.416079:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc188548e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:880710ad-110c-42a4-a174-ab1b99a7ebeb:3306:1876092510036992:0@lo:400: 00010000:00080000:0.0:1789181372.416089:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc188548000 x1876092510037632/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181388 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181372.416097:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc188548000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876092510037632:0@lo:400: 00000100:00100000:3.0:1789181372.927350:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789181372.927374:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c026d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876092510037760:0@lo:13: 00000100:00100000:3.0:1789181372.927442:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181372.927566:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510037760 00000100:00100000:0.0:1789181372.927581:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510037760 00000100:00100000:0.0:1789181372.927635:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789181372.927645:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c36ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876092510037760:12345-0@lo:13: 00002000:00000024:0.0:1789181372.927677:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789181372.927723:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c36ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876092510037760:12345-0@lo:13: Request processed in 80us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181372.927730:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1789181372.927775:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc1c026d880 x1876092510037760/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181388 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181372.927794:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c026d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876092510037760:0@lo:13: 00010000:00010000:2.0:1789181372.992378:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181374.015859:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789181374.425764:0:8451:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc5a5d9280 20000000:00000080:0.0:1789181374.425783:0:8451:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9dc08128a800 uarg=0000000000000000 20000000:01000000:0.0:1789181374.425820:0:8451:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1789181374.425822:0:8451:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1789181374.425825:0:8451:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1789181374.425832:0:8451:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1789181374.425837:0:8451:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1789181374.425853:0:8451:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1789181374.425855:0:8451:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1789181374.427254:0:8451:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1789181374.427259:0:8451:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789181374.435056:0:8452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:1.0:1789181374.440031:0:8451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:1.0:1789181374.440109:0:8451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:1.0:1789181374.440163:0:8451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:1.0:1789181374.440178:0:8451:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1789181374.440181:0:8451:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1789181374.444814:0:8453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:1.0:1789181374.449497:0:8451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:1.0:1789181374.449584:0:8451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:1.0:1789181374.449649:0:8451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:1.0:1789181374.449668:0:8451:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1789181374.449671:0:8451:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789181374.455099:0:8454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1789181374.456088:0:8451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1789181374.456168:0:8451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:1.0:1789181374.456203:0:8451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:1.0:1789181374.456215:0:8451:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1789181374.456218:0:8451:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1789181374.463565:0:8455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:0.0:1789181374.467058:0:8451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:0.0:1789181374.467298:0:8451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:0.0:1789181374.467373:0:8451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 10000000:01000000:0.0:1789181374.467389:0:8451:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789181374.467409:0:8451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dc180030c00/0x8f4f7840b2e4113f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181374.467438:0:8451:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dc1c2045c00/0x8f4f7840b2e4103c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e41035 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181374.467454:0:8451:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dc18151a000/0x8f4f7840b2e41066 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e4105f expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181374.467460:0:8451:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dc1c2045000/0x8f4f7840b2e41090 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e41089 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181374.467467:0:8451:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dc180031600/0x8f4f7840b2e4109e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e41097 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181374.467472:0:8451:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dc18151b400/0x8f4f7840b2e410ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e410a5 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181374.467478:0:8451:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dc1c2044600/0x8f4f7840b2e410c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e410c1 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181374.467484:0:8451:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dc1c2175800/0x8f4f7840b2e410f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e410eb expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181374.467494:0:8451:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dc18151ac00/0x8f4f7840b2e41100 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91eef8 expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181374.467501:0:8451:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dc180030200/0x8f4f7840b2e41107 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91eeff expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181374.467509:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9dc180030c00/0x8f4f7840b2e4113f lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181374.467547:0:8451:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dc180030200/0x8f4f7840b2e41107 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91eeff expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181374.467572:0:8451:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dc180030200/0x8f4f7840b2e41107 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91eeff expref: 9 pid: 5837 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181374.467587:0:8451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c026d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8451:1876092510037888:192.168.204.32@tcp:104: 00010000:00010000:0.0:1789181374.469208:0:8451:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dc18151ac00/0x8f4f7840b2e41100 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91eef8 expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181374.469227:0:8451:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dc18151ac00/0x8f4f7840b2e41100 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91eef8 expref: 9 pid: 5836 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181374.469242:0:8451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6b52300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8451:1876092510038016:192.168.204.32@tcp:104: 00010000:00010000:0.0:1789181374.472887:0:8451:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dc1c2175800/0x8f4f7840b2e410f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8f4f7840b2e410eb expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181374.473011:0:8451:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dc1c2175800/0x8f4f7840b2e410f2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8f4f7840b2e410eb expref: 18 pid: 5835 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181374.473027:0:8451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6b50e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8451:1876092510038144:0@lo:104: 00000100:00100000:0.0:1789181374.473090:0:8451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789181374.473216:0:8451:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dc1c2044600/0x8f4f7840b2e410c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8f4f7840b2e410c1 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181374.473226:0:8451:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dc1c2044600/0x8f4f7840b2e410c8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8f4f7840b2e410c1 expref: 18 pid: 5835 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181374.473235:0:8451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6b50000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8451:1876092510038272:0@lo:104: 00000100:00100000:0.0:1789181374.473264:0:8451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181374.473535:0:5826:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789181374.473550:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510038144 00000100:00100000:1.0:1789181374.473558:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510038144 00000100:00100000:1.0:1789181374.473597:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510038272 00000100:00100000:1.0:1789181374.473600:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510038272 00000100:00100000:1.0:1789181374.473617:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789181374.473627:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6b52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:880710ad-110c-42a4-a174-ab1b99a7ebeb+4:8451:x1876092510038144:12345-0@lo:104: 00010000:00010000:1.0:1789181374.473639:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.132@tcp lock: ffff9dc18151aa00/0x8f4f7840b2e410eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f4f7840b2e410f2 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181374.473686:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789181374.473692:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6b52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:880710ad-110c-42a4-a174-ab1b99a7ebeb+4:8451:x1876092510038144:12345-0@lo:104: Request processed in 68us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181374.473705:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789181374.473722:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789181374.473728:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1ba444c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:880710ad-110c-42a4-a174-ab1b99a7ebeb+3:8451:x1876092510038272:12345-0@lo:104: 00010000:00010000:1.0:1789181374.473735:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.132@tcp lock: ffff9dc18151a600/0x8f4f7840b2e410c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f4f7840b2e410c8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181374.473769:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789181374.473774:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1ba444c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:880710ad-110c-42a4-a174-ab1b99a7ebeb+3:8451:x1876092510038272:12345-0@lo:104: Request processed in 47us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181374.473778:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:1.0:1789181374.473810:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789181374.473816:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.132@tcp lock: ffff9dc18151aa00/0x8f4f7840b2e410eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f4f7840b2e410f2 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181374.473823:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc18151aa00 already unused, calling callback (ffffffffc1b45c20) 10000000:00010000:1.0:1789181374.473827:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.132@tcp lock: ffff9dc18151aa00/0x8f4f7840b2e410eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x8f4f7840b2e410f2 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181374.473835:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.132@tcp lock: ffff9dc18151aa00/0x8f4f7840b2e410eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x8f4f7840b2e410f2 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789181374.473842:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.132@tcp lock: ffff9dc18151aa00/0x8f4f7840b2e410eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x8f4f7840b2e410f2 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789181374.473847:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789181374.473875:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.132@tcp lock: ffff9dc18151aa00/0x8f4f7840b2e410eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e410f2 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181374.473881:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789181374.473925:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.132@tcp lock: ffff9dc18151aa00/0x8f4f7840b2e410eb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e410f2 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181374.473932:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.132@tcp lock: ffff9dc18151aa00/0x8f4f7840b2e410eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e410f2 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181374.473945:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789181374.473948:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.132@tcp lock: ffff9dc18151a600/0x8f4f7840b2e410c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f4f7840b2e410c8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181374.473953:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc18151a600 already unused, calling callback (ffffffffc1b45c20) 10000000:00010000:1.0:1789181374.473955:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.132@tcp lock: ffff9dc18151a600/0x8f4f7840b2e410c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x8f4f7840b2e410c8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181374.473962:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.132@tcp lock: ffff9dc18151a600/0x8f4f7840b2e410c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x8f4f7840b2e410c8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789181374.473967:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.132@tcp lock: ffff9dc18151a600/0x8f4f7840b2e410c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x8f4f7840b2e410c8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789181374.473972:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789181374.473984:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.132@tcp lock: ffff9dc18151a600/0x8f4f7840b2e410c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e410c8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181374.473989:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789181374.474003:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.132@tcp lock: ffff9dc18151a600/0x8f4f7840b2e410c1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e410c8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181374.474009:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.132@tcp lock: ffff9dc18151a600/0x8f4f7840b2e410c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e410c8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181374.474016:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181374.474023:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181374.474024:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181374.474031:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181374.474049:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfcf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:880710ad-110c-42a4-a174-ab1b99a7ebeb:3304:1876092510038400:0@lo:103: 00000100:00100000:1.0:1789181374.474076:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181374.474114:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfcf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:880710ad-110c-42a4-a174-ab1b99a7ebeb:3305:1876092510038528:0@lo:103: 00000100:00100000:1.0:1789181374.474136:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181374.474269:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510038400 00000100:00100000:1.0:1789181374.474274:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510038400 00010000:00010000:1.0:1789181374.474294:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dc1c2175800/0x8f4f7840b2e410f2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f4f7840b2e410eb expref: 19 pid: 5835 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181374.474313:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510038528 00000100:00100000:1.0:1789181374.474316:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510038528 00010000:00010000:1.0:1789181374.474326:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dc1c2044600/0x8f4f7840b2e410c8 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f4f7840b2e410c1 expref: 20 pid: 5835 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181374.474376:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789181374.474384:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfcf5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:880710ad-110c-42a4-a174-ab1b99a7ebeb+20:3304:x1876092510038400:12345-0@lo:103: 00010000:00010000:1.0:1789181374.474394:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789181374.474476:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dc1c2175800/0x8f4f7840b2e410f2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f4f7840b2e410eb expref: 20 pid: 5835 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181374.474488:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dc1c2175800/0x8f4f7840b2e410f2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8f4f7840b2e410eb expref: 20 pid: 5835 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181374.474502:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789181374.474522:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789181374.474536:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfcf5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:880710ad-110c-42a4-a174-ab1b99a7ebeb+20:3305:x1876092510038528:12345-0@lo:103: 00000100:00100000:1.0:1789181374.474538:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfcf5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:880710ad-110c-42a4-a174-ab1b99a7ebeb+20:3304:x1876092510038400:12345-0@lo:103: Request processed in 153us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181374.474549:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1789181374.474550:0:6707:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789181374.474557:0:6707:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dc1c2044600/0x8f4f7840b2e410c8 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f4f7840b2e410c1 expref: 20 pid: 5835 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181374.474569:0:6707:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dc1c2044600/0x8f4f7840b2e410c8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8f4f7840b2e410c1 expref: 19 pid: 5835 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181374.474582:0:6707:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789181374.474598:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfcf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:880710ad-110c-42a4-a174-ab1b99a7ebeb:3304:1876092510038400:0@lo:103: 00000100:00100000:3.0:1789181374.474618:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfcf5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:3305:x1876092510038528:12345-0@lo:103: Request processed in 86us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181374.474626:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfcf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:880710ad-110c-42a4-a174-ab1b99a7ebeb:3305:1876092510038528:0@lo:103: 00000100:00100000:3.0:1789181374.474627:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:2.0:1789181374.476935:0:8451:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dc18151b400/0x8f4f7840b2e410ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8f4f7840b2e410a5 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181374.476955:0:8451:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dc18151b400/0x8f4f7840b2e410ac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8f4f7840b2e410a5 expref: 18 pid: 5836 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181374.476970:0:8451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b66f6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8451:1876092510038656:0@lo:104: 00000100:00100000:2.0:1789181374.477028:0:8451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789181374.477070:0:8451:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dc180031600/0x8f4f7840b2e4109e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8f4f7840b2e41097 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181374.477077:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00010000:00010000:2.0:1789181374.477084:0:8451:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dc180031600/0x8f4f7840b2e4109e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8f4f7840b2e41097 expref: 18 pid: 5835 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181374.477103:0:8451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b66f6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8451:1876092510038784:0@lo:104: 00000100:00100000:0.0:1789181374.477130:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00000100:00100000:0.0:1789181374.477139:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510038656 00000100:00100000:3.0:1789181374.477143:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181374.477144:0:8451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181374.477146:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510038656 00010000:00010000:2.0:1789181374.477171:0:8451:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dc1c2045000/0x8f4f7840b2e41090 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8f4f7840b2e41089 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181374.477176:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092487995392 00010000:00010000:2.0:1789181374.477180:0:8451:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dc1c2045000/0x8f4f7840b2e41090 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8f4f7840b2e41089 expref: 18 pid: 5836 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181374.477182:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510038784 00000100:00100000:3.0:1789181374.477184:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092487995392 00000100:00100000:0.0:1789181374.477186:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510038784 00000100:00100000:2.0:1789181374.477192:0:8451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b66f7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8451:1876092510038912:0@lo:104: 00000100:00100000:0.0:1789181374.477202:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789181374.477214:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b66f7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:880710ad-110c-42a4-a174-ab1b99a7ebeb+4:8451:x1876092510038656:12345-0@lo:104: 00010000:00010000:3.0:1789181374.477216:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dc180030200/0x8f4f7840b2e41107 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91eeff expref: 10 pid: 5837 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181374.477216:0:8451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789181374.477227:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.132@tcp lock: ffff9dc1c2045800/0x8f4f7840b2e410a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f4f7840b2e410ac expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181374.477235:0:8451:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dc18151a000/0x8f4f7840b2e41066 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8f4f7840b2e4105f expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181374.477243:0:8451:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dc18151a000/0x8f4f7840b2e41066 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8f4f7840b2e4105f expref: 18 pid: 5836 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181374.477244:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092487995520 00000100:00100000:3.0:1789181374.477250:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092487995520 00000100:00100000:2.0:1789181374.477255:0:8451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b66f6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8451:1876092510039040:0@lo:104: 00010000:00010000:3.0:1789181374.477273:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dc18151ac00/0x8f4f7840b2e41100 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91eef8 expref: 11 pid: 5836 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181374.477274:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789181374.477279:0:8451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181374.477282:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b66f7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:880710ad-110c-42a4-a174-ab1b99a7ebeb+4:8451:x1876092510038656:12345-0@lo:104: Request processed in 72us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181374.477293:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:2.0:1789181374.477296:0:8451:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dc1c2045c00/0x8f4f7840b2e4103c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8f4f7840b2e41035 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181374.477304:0:8451:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dc1c2045c00/0x8f4f7840b2e4103c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8f4f7840b2e41035 expref: 18 pid: 5836 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181374.477308:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 14 00010000:00010000:0.0:1789181374.477313:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1789181374.477318:0:8451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b66f7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8451:1876092510039168:0@lo:104: 00010000:00010000:0.0:1789181374.477319:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.132@tcp lock: ffff9dc1c2045800/0x8f4f7840b2e410a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f4f7840b2e410ac expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181374.477324:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c36ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:975a0591-a8f7-4a74-9f93-a5aa77f2315c+11:2354:x1876092487995392:12345-192.168.204.32@tcp:103: 00010000:00010000:0.0:1789181374.477351:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1c2045800 already unused, calling callback (ffffffffc1b45c20) 10000000:00010000:0.0:1789181374.477357:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.132@tcp lock: ffff9dc1c2045800/0x8f4f7840b2e410a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x8f4f7840b2e410ac expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181374.477362:0:8451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789181374.477367:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.132@tcp lock: ffff9dc1c2045800/0x8f4f7840b2e410a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x8f4f7840b2e410ac expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789181374.477374:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.132@tcp lock: ffff9dc1c2045800/0x8f4f7840b2e410a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x8f4f7840b2e410ac expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181374.477377:0:8451:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1bfb33540 going to sleep for 11 seconds 10000000:01000000:0.0:1789181374.477380:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1789181374.477396:0:8451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c026d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8451:1876092510037888:192.168.204.32@tcp:104: 00000100:00100000:2.0:1789181374.477415:0:8451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6b52300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8451:1876092510038016:192.168.204.32@tcp:104: 00010000:00010000:0.0:1789181374.477415:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.132@tcp lock: ffff9dc1c2045800/0x8f4f7840b2e410a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e410ac expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181374.477434:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc1c2175800/0x8f4f7840b2e410f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8f4f7840b2e410eb expref: 18 pid: 5835 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181374.477437:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789181374.477448:0:8451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6b50e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8451:1876092510038144:0@lo:104: 00010000:00010000:0.0:1789181374.477454:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.132@tcp lock: ffff9dc1c2045800/0x8f4f7840b2e410a5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e410ac expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181374.477457:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc1c2044600/0x8f4f7840b2e410c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8f4f7840b2e410c1 expref: 17 pid: 5835 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181374.477461:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.132@tcp lock: ffff9dc1c2045800/0x8f4f7840b2e410a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e410ac expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181374.477471:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181374.477473:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181374.477475:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181374.477477:0:8451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6b50000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8451:1876092510038272:0@lo:104: 00000100:00100000:2.0:1789181374.477484:0:8451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b66f6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8451:1876092510038656:0@lo:104: 00000100:00100000:0.0:1789181374.477485:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6b51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:880710ad-110c-42a4-a174-ab1b99a7ebeb:3306:1876092510039296:0@lo:103: 00000100:00100000:0.0:1789181374.477510:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181374.477540:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510038912 00000100:00100000:0.0:1789181374.477544:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510038912 00000100:00100000:0.0:1789181374.477557:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510039040 00000100:00100000:0.0:1789181374.477559:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510039040 00000100:00100000:0.0:1789181374.477570:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510039168 00000100:00100000:0.0:1789181374.477573:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510039168 00000100:00100000:0.0:1789181374.477583:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789181374.477588:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b66f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:880710ad-110c-42a4-a174-ab1b99a7ebeb+6:8451:x1876092510038784:12345-0@lo:104: 00010000:00010000:0.0:1789181374.477595:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.132@tcp lock: ffff9dc1c2174200/0x8f4f7840b2e41097 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f4f7840b2e4109e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181374.477636:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:3.0:1789181374.477642:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789181374.477642:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b66f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:880710ad-110c-42a4-a174-ab1b99a7ebeb+6:8451:x1876092510038784:12345-0@lo:104: Request processed in 54us (501us total) trans 0 rc 0/0 00010000:00010000:3.0:1789181374.477654:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dc180030200/0x8f4f7840b2e41107 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91eeff expref: 11 pid: 5837 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181374.477654:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:0.0:1789181374.477671:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789181374.477681:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.132@tcp lock: ffff9dc1c2174200/0x8f4f7840b2e41097 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f4f7840b2e4109e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181374.477688:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1c2174200 already unused, calling callback (ffffffffc1b45c20) 10000000:00010000:0.0:1789181374.477691:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.132@tcp lock: ffff9dc1c2174200/0x8f4f7840b2e41097 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x8f4f7840b2e4109e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181374.477698:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.132@tcp lock: ffff9dc1c2174200/0x8f4f7840b2e41097 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x8f4f7840b2e4109e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789181374.477704:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.132@tcp lock: ffff9dc1c2174200/0x8f4f7840b2e41097 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x8f4f7840b2e4109e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789181374.477709:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789181374.477729:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.132@tcp lock: ffff9dc1c2174200/0x8f4f7840b2e41097 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e4109e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181374.477735:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789181374.477748:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.132@tcp lock: ffff9dc1c2174200/0x8f4f7840b2e41097 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e4109e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181374.477753:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.132@tcp lock: ffff9dc1c2174200/0x8f4f7840b2e41097 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e4109e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181374.477763:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181374.477765:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181374.477766:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181374.477775:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6b51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:880710ad-110c-42a4-a174-ab1b99a7ebeb:3303:1876092510039424:0@lo:103: 00000100:00100000:0.0:1789181374.477796:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181374.477822:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00010000:00010000:3.0:1789181374.477827:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dc180030200/0x8f4f7840b2e41107 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91eeff expref: 11 pid: 5837 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181374.477832:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b66f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:880710ad-110c-42a4-a174-ab1b99a7ebeb+5:8451:x1876092510038912:12345-0@lo:104: 00010000:00010000:3.0:1789181374.477847:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc180030200/0x8f4f7840b2e41107 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91eeff expref: 11 pid: 5837 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181374.477848:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.132@tcp lock: ffff9dc180030600/0x8f4f7840b2e41089 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f4f7840b2e41090 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181374.477873:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789181374.477912:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789181374.477923:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c36ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:975a0591-a8f7-4a74-9f93-a5aa77f2315c+10:2354:x1876092487995392:12345-192.168.204.32@tcp:103: Request processed in 601us (849us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181374.477923:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b66f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:880710ad-110c-42a4-a174-ab1b99a7ebeb+5:8451:x1876092510038912:12345-0@lo:104: Request processed in 89us (703us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181374.477937:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789181374.477940:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 14 00010000:00010000:0.0:1789181374.477954:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789181374.477959:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.132@tcp lock: ffff9dc180030600/0x8f4f7840b2e41089 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f4f7840b2e41090 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181374.477961:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510039296 00000100:00100000:3.0:1789181374.477966:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510039296 00010000:00010000:0.0:1789181374.477969:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc180030600 already unused, calling callback (ffffffffc1b45c20) 10000000:00010000:0.0:1789181374.477973:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.132@tcp lock: ffff9dc180030600/0x8f4f7840b2e41089 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8f4f7840b2e41090 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181374.477979:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.132@tcp lock: ffff9dc180030600/0x8f4f7840b2e41089 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8f4f7840b2e41090 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789181374.477985:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.132@tcp lock: ffff9dc180030600/0x8f4f7840b2e41089 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8f4f7840b2e41090 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789181374.477991:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789181374.477993:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dc18151b400/0x8f4f7840b2e410ac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f4f7840b2e410a5 expref: 17 pid: 5836 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181374.478012:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.132@tcp lock: ffff9dc180030600/0x8f4f7840b2e41089 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e41090 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181374.478018:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789181374.478020:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510039424 00000100:00100000:3.0:1789181374.478025:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510039424 00010000:00010000:0.0:1789181374.478028:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.132@tcp lock: ffff9dc180030600/0x8f4f7840b2e41089 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e41090 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181374.478034:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.132@tcp lock: ffff9dc180030600/0x8f4f7840b2e41089 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e41090 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181374.478042:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dc180031600/0x8f4f7840b2e4109e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f4f7840b2e41097 expref: 18 pid: 5835 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181374.478057:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181374.478061:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789181374.478064:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 15 00010000:00010000:0.0:1789181374.478065:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789181374.478077:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c36dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:975a0591-a8f7-4a74-9f93-a5aa77f2315c+9:2354:x1876092487995520:12345-192.168.204.32@tcp:103: 00000100:00100000:0.0:1789181374.478078:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1789181374.478088:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789181374.478089:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6b51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:880710ad-110c-42a4-a174-ab1b99a7ebeb:3303:1876092510039552:0@lo:103: 00010000:00010000:3.0:1789181374.478097:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dc18151ac00/0x8f4f7840b2e41100 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91eef8 expref: 9 pid: 5836 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181374.478119:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dc18151ac00/0x8f4f7840b2e41100 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91eef8 expref: 9 pid: 5836 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181374.478121:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789181374.478137:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc18151ac00/0x8f4f7840b2e41100 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91eef8 expref: 9 pid: 5836 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181374.478148:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789181374.478154:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789181374.478162:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b66f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:880710ad-110c-42a4-a174-ab1b99a7ebeb+4:8451:x1876092510039040:12345-0@lo:104: 00010000:00010000:0.0:1789181374.478171:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.132@tcp lock: ffff9dc180031400/0x8f4f7840b2e4105f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f4f7840b2e41066 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181374.478178:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c36dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:975a0591-a8f7-4a74-9f93-a5aa77f2315c+8:2354:x1876092487995520:12345-192.168.204.32@tcp:103: Request processed in 103us (1037us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181374.478187:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 15 00000100:00100000:3.0:1789181374.478203:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510039552 00000100:00100000:3.0:1789181374.478207:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510039552 00010000:00010000:0.0:1789181374.478211:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789181374.478219:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b66f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:880710ad-110c-42a4-a174-ab1b99a7ebeb+4:8451:x1876092510039040:12345-0@lo:104: Request processed in 57us (941us total) trans 0 rc 0/0 00010000:00010000:3.0:1789181374.478222:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dc1c2045000/0x8f4f7840b2e41090 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f4f7840b2e41089 expref: 19 pid: 5836 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181374.478230:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789181374.478245:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00010000:00010000:0.0:1789181374.478251:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1789181374.478254:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6b50a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:3306:x1876092510039296:12345-0@lo:103: 00010000:00010000:0.0:1789181374.478257:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.132@tcp lock: ffff9dc180031400/0x8f4f7840b2e4105f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f4f7840b2e41066 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181374.478271:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc180031400 already unused, calling callback (ffffffffc1b45c20) 00010000:00010000:3.0:1789181374.478275:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 10000000:00010000:0.0:1789181374.478275:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.132@tcp lock: ffff9dc180031400/0x8f4f7840b2e4105f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8f4f7840b2e41066 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181374.478286:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dc18151b400/0x8f4f7840b2e410ac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f4f7840b2e410a5 expref: 19 pid: 5836 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181374.478287:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.132@tcp lock: ffff9dc180031400/0x8f4f7840b2e4105f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8f4f7840b2e41066 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789181374.478304:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.132@tcp lock: ffff9dc180031400/0x8f4f7840b2e4105f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8f4f7840b2e41066 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789181374.478318:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789181374.478322:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dc18151b400/0x8f4f7840b2e410ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8f4f7840b2e410a5 expref: 19 pid: 5836 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181374.478360:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc18151b400/0x8f4f7840b2e410ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8f4f7840b2e410a5 expref: 19 pid: 5836 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181374.478360:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.132@tcp lock: ffff9dc180031400/0x8f4f7840b2e4105f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e41066 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181374.478371:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789181374.478382:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.132@tcp lock: ffff9dc180031400/0x8f4f7840b2e4105f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e41066 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181374.478389:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.132@tcp lock: ffff9dc180031400/0x8f4f7840b2e4105f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e41066 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181374.478399:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181374.478400:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181374.478402:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181374.478409:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789181374.478416:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6b50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:880710ad-110c-42a4-a174-ab1b99a7ebeb:3306:1876092510039680:0@lo:103: 00000100:00100000:0.0:1789181374.478452:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181374.478478:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789181374.478484:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b66f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:880710ad-110c-42a4-a174-ab1b99a7ebeb+3:8451:x1876092510039168:12345-0@lo:104: 00010000:00010000:0.0:1789181374.478492:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.132@tcp lock: ffff9dc18151a800/0x8f4f7840b2e41035 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f4f7840b2e4103c expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181374.478521:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789181374.478526:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b66f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:880710ad-110c-42a4-a174-ab1b99a7ebeb+3:8451:x1876092510039168:12345-0@lo:104: Request processed in 43us (1163us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181374.478531:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1789181374.478543:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789181374.478546:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.132@tcp lock: ffff9dc18151a800/0x8f4f7840b2e41035 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f4f7840b2e4103c expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181374.478558:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc18151a800 already unused, calling callback (ffffffffc1b45c20) 10000000:00010000:0.0:1789181374.478561:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.132@tcp lock: ffff9dc18151a800/0x8f4f7840b2e41035 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8f4f7840b2e4103c expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181374.478568:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.132@tcp lock: ffff9dc18151a800/0x8f4f7840b2e41035 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8f4f7840b2e4103c expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789181374.478574:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.132@tcp lock: ffff9dc18151a800/0x8f4f7840b2e41035 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8f4f7840b2e4103c expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789181374.478579:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789181374.478613:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.132@tcp lock: ffff9dc18151a800/0x8f4f7840b2e41035 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e4103c expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181374.478620:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789181374.478629:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.132@tcp lock: ffff9dc18151a800/0x8f4f7840b2e41035 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e4103c expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181374.478636:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.132@tcp lock: ffff9dc18151a800/0x8f4f7840b2e41035 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e4103c expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181374.478649:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181374.478651:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181374.478653:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181374.478662:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c0268000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:880710ad-110c-42a4-a174-ab1b99a7ebeb:3306:1876092510039808:0@lo:103: 00000100:00100000:0.0:1789181374.478686:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789181374.479610:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789181374.479656:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6b50a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:880710ad-110c-42a4-a174-ab1b99a7ebeb+18:3306:x1876092510039296:12345-0@lo:103: Request processed in 1404us (2145us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181374.479664:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789181374.479826:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6b51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:880710ad-110c-42a4-a174-ab1b99a7ebeb:3306:1876092510039296:0@lo:103: 00000100:00100000:2.0:1789181374.479897:0:8451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b66f6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8451:1876092510038784:0@lo:104: 00000100:00100000:2.0:1789181374.479907:0:8451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b66f7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8451:1876092510038912:0@lo:104: 00000100:00100000:2.0:1789181374.479927:0:8451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b66f6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8451:1876092510039040:0@lo:104: 00000100:00100000:2.0:1789181374.479936:0:8451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b66f7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8451:1876092510039168:0@lo:104: 00010000:00010000:2.0:1789181374.479971:0:8451:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9dc180030c00/0x8f4f7840b2e4113f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181374.480241:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510039680 00000100:00100000:3.0:1789181374.480247:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510039680 00010000:00010000:3.0:1789181374.480268:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dc18151a000/0x8f4f7840b2e41066 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f4f7840b2e4105f expref: 18 pid: 5836 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181374.480281:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510039808 00000100:00100000:3.0:1789181374.480284:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510039808 00010000:00010000:3.0:1789181374.480294:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dc1c2045c00/0x8f4f7840b2e4103c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f4f7840b2e41035 expref: 19 pid: 5836 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181374.480305:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789181374.480311:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6b51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:3303:x1876092510039424:12345-0@lo:103: 00010000:00010000:3.0:1789181374.480321:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789181374.480325:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dc180031600/0x8f4f7840b2e4109e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f4f7840b2e41097 expref: 19 pid: 5835 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181374.480525:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789181374.480542:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1960f2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:3303:x1876092510039552:12345-0@lo:103: 00010000:00010000:0.0:1789181374.480552:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789181374.480559:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dc1c2045000/0x8f4f7840b2e41090 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f4f7840b2e41089 expref: 19 pid: 5836 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181374.480568:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dc1c2045000/0x8f4f7840b2e41090 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8f4f7840b2e41089 expref: 19 pid: 5836 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181374.480583:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc1c2045000/0x8f4f7840b2e41090 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8f4f7840b2e41089 expref: 19 pid: 5836 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181374.480593:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789181374.480677:0:6707:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:2.0:1789181374.480686:0:6707:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00000100:00100000:0.0:1789181374.480694:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1960f2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:880710ad-110c-42a4-a174-ab1b99a7ebeb+18:3303:x1876092510039552:12345-0@lo:103: Request processed in 155us (2574us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181374.480700:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789181374.480716:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789181374.480721:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6b52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:880710ad-110c-42a4-a174-ab1b99a7ebeb+17:3306:x1876092510039680:12345-0@lo:103: 00010000:00010000:0.0:1789181374.480728:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789181374.480732:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dc18151a000/0x8f4f7840b2e41066 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f4f7840b2e4105f expref: 17 pid: 5836 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181374.480739:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dc18151a000/0x8f4f7840b2e41066 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8f4f7840b2e4105f expref: 17 pid: 5836 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181374.480749:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc18151a000/0x8f4f7840b2e41066 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8f4f7840b2e4105f expref: 17 pid: 5836 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181374.480757:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789181374.480783:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6b52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:880710ad-110c-42a4-a174-ab1b99a7ebeb+16:3306:x1876092510039680:12345-0@lo:103: Request processed in 62us (2330us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181374.480797:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789181374.480810:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789181374.480816:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c026aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:880710ad-110c-42a4-a174-ab1b99a7ebeb+15:3306:x1876092510039808:12345-0@lo:103: 00010000:00010000:0.0:1789181374.480824:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789181374.480828:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dc1c2045c00/0x8f4f7840b2e4103c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f4f7840b2e41035 expref: 15 pid: 5836 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181374.480836:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dc1c2045c00/0x8f4f7840b2e4103c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8f4f7840b2e41035 expref: 15 pid: 5836 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181374.480845:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc1c2045c00/0x8f4f7840b2e4103c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8f4f7840b2e41035 expref: 15 pid: 5836 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181374.480853:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789181374.480877:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c026aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:880710ad-110c-42a4-a174-ab1b99a7ebeb+14:3306:x1876092510039808:12345-0@lo:103: Request processed in 62us (2191us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181374.480882:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789181374.480923:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c0268000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:880710ad-110c-42a4-a174-ab1b99a7ebeb:3306:1876092510039808:0@lo:103: 00000100:00100000:0.0:1789181374.480931:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6b50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:880710ad-110c-42a4-a174-ab1b99a7ebeb:3306:1876092510039680:0@lo:103: 00000100:00100000:1.0:1789181374.481595:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6b51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:880710ad-110c-42a4-a174-ab1b99a7ebeb:3303:1876092510039552:0@lo:103: 00010000:00010000:3.0:1789181374.482362:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dc180031600/0x8f4f7840b2e4109e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8f4f7840b2e41097 expref: 13 pid: 5835 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181374.482501:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc180031600/0x8f4f7840b2e4109e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8f4f7840b2e41097 expref: 13 pid: 5835 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181374.482516:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9dc180030c00/0x8f4f7840b2e4113f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181374.482524:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc180030c00/0x8f4f7840b2e4113f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181374.482540:0:5828:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dc180030c00/0x8f4f7840b2e4113f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181374.482546:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dc180030c00/0x8f4f7840b2e4113f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181374.482553:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dc180030c00/0x8f4f7840b2e4113f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181374.482559:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dc180030c00/0x8f4f7840b2e4113f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181374.482565:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc180030c00 already unused, calling callback (ffffffffc152f9b0) 00010000:00010000:3.0:1789181374.482570:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dc180030c00/0x8f4f7840b2e4113f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181374.482577:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dc180030c00/0x8f4f7840b2e4113f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181374.482615:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dc180030c00/0x8f4f7840b2e4113f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181374.482627:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789181374.482643:0:8451:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9dc180030c00/0x8f4f7840b2e4113f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181374.482654:0:8451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dc180030c00/0x8f4f7840b2e4113f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181374.482662:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc180030c00/0x8f4f7840b2e4113f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181374.484344:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6b51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:880710ad-110c-42a4-a174-ab1b99a7ebeb+12:3303:x1876092510039424:12345-0@lo:103: Request processed in 4012us (6526us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181374.484358:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789181374.484765:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6b51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:880710ad-110c-42a4-a174-ab1b99a7ebeb:3303:1876092510039424:0@lo:103: 00000100:00100000:3.0:1789181374.565577:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181374.565623:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181374.565638:0:6894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092487995776 00000100:00100000:1.0:1789181374.565650:0:6894:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092487995776 00000100:00100000:3.0:1789181374.565658:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181374.565682:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092487995904 00000100:00100000:3.0:1789181374.565687:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092487995904 00000100:00100000:3.0:1789181374.565738:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 13 00000100:00100000:3.0:1789181374.565748:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c36fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+5:2353:x1876092487995904:12345-192.168.204.32@tcp:400: 00000100:00100000:1.0:1789181374.565804:0:6894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 14 00000100:00100000:1.0:1789181374.565815:0:6894:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c36ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+5:2353:x1876092487995776:12345-192.168.204.32@tcp:400: 00000100:00100000:3.0:1789181374.565819:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c36fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+5:2353:x1876092487995904:12345-192.168.204.32@tcp:400: Request processed in 70us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181374.565828:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 13 00000100:00100000:1.0:1789181374.565856:0:6894:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c36ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+5:2353:x1876092487995776:12345-192.168.204.32@tcp:400: Request processed in 43us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181374.565863:0:6894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 14 00000100:00100000:2.0:1789181374.565920:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092487995648 00000100:00100000:2.0:1789181374.565925:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092487995648 00000100:00100000:2.0:1789181374.565974:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 27 00000100:00100000:2.0:1789181374.565983:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c36dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+6:2353:x1876092487995648:12345-192.168.204.32@tcp:400: 00000100:00100000:2.0:1789181374.566670:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c36dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+6:2353:x1876092487995648:12345-192.168.204.32@tcp:400: Request processed in 685us (1042us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181374.566678:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 27 00000100:00080000:0.0:1789181374.566957:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789181374.566963:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789181374.566966:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789181375.038729:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181375.487135:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789181375.487161:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc19c36c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876092510039936:0@lo:13: 00000100:00100000:0.0:1789181375.487236:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181375.487372:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510039936 00000100:00100000:1.0:1789181375.487380:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510039936 00000100:00100000:1.0:1789181375.487455:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789181375.487467:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c0268000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876092510039936:12345-0@lo:13: 00002000:00000024:1.0:1789181375.487502:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789181375.487551:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c0268000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876092510039936:12345-0@lo:13: Request processed in 87us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181375.487558:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1789181375.491238:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789181375.491324:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc19c36c380 x1876092510039936/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181391 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181375.491413:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc19c36c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876092510039936:0@lo:13: 10000000:01000000:0.0:1789181375.934499:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789181375.934507:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9dc08132f800 from 39 10000000:01000000:0.0:1789181375.934512:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789181375.934561:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc180031400/0x8f4f7840b2e41146 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181375.934574:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.132@tcp lock: ffff9dc180031400/0x8f4f7840b2e41146 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181375.934586:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.132@tcp lock: ffff9dc180031400/0x8f4f7840b2e41146 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181375.934609:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c026b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510040064:0@lo:101: 00000100:00100000:0.0:1789181375.934680:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181375.934734:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1989bc9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789181375.935196:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510040064 00000100:00100000:3.0:1789181375.935205:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510040064 00000100:00100000:3.0:1789181375.935266:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789181375.935278:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189955050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+12:5840:x1876092510040064:12345-0@lo:101: 00010000:00010000:3.0:1789181375.935291:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181375.935304:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc1bfa1e000/0x8f4f7840b2e4114d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f4f7840b2e41146 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181375.935327:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc1bfa1e000/0x8f4f7840b2e4114d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f4f7840b2e41146 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181375.935380:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc1bfa1e000/0x8f4f7840b2e4114d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e41146 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181375.935390:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1bfa1e000, rc 0) 00000100:00100000:3.0:1789181375.935458:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189955050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+13:5840:x1876092510040064:12345-0@lo:101: Request processed in 183us (778us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181375.935465:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1789181375.935518:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c026b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510040064:0@lo:101: 00010000:00010000:1.0:1789181375.935535:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.132@tcp lock: ffff9dc180031400/0x8f4f7840b2e41146 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e4114d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181375.935544:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.132@tcp lock: ffff9dc180031400/0x8f4f7840b2e41146 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f4f7840b2e4114d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181375.935607:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfcf5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510040192:0@lo:501: 00000100:00100000:1.0:1789181375.935640:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181375.935676:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1c051af00 going to sleep for 11 seconds 00000100:00100000:2.0:1789181375.935736:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510040192 00000100:00100000:2.0:1789181375.935741:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510040192 00000100:00100000:2.0:1789181375.935787:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789181375.935795:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189955850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+13:5840:x1876092510040192:12345-0@lo:501: 00000100:00100000:2.0:1789181375.936266:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189955850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+13:5840:x1876092510040192:12345-0@lo:501: Request processed in 471us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181375.936274:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1789181375.940649:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfcf5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510040192:0@lo:501: 00000100:00100000:1.0:1789181375.940717:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfcf5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510040320:0@lo:503: 00000100:00100000:1.0:1789181375.940810:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181375.940869:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1c051af00 going to sleep for 11 seconds 00000100:00100000:3.0:1789181375.941064:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510040320 00000100:00100000:3.0:1789181375.941072:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510040320 00000100:00100000:3.0:1789181375.941133:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1789181375.941142:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189957450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+13:5840:x1876092510040320:12345-0@lo:503: 00000100:00100000:3.0:1789181375.941386:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189957450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+13:5840:x1876092510040320:12345-0@lo:503: Request processed in 245us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181375.941394:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789181375.941690:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfcf5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510040320:0@lo:503: 00000100:00100000:1.0:1789181375.942327:0:8469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfcf5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:880710ad-110c-42a4-a174-ab1b99a7ebeb:8469:1876092510040448:0@lo:502: 00000100:00100000:1.0:1789181375.942620:0:8469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181375.942658:0:8469:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1c051a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789181375.942709:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510040448 00000100:00100000:0.0:1789181375.942715:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510040448 00000100:00100000:0.0:1789181375.942757:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789181375.942764:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189957c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+13:8469:x1876092510040448:12345-0@lo:502: 00000100:00100000:0.0:1789181375.942987:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189957c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+13:8469:x1876092510040448:12345-0@lo:502: Request processed in 223us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181375.942995:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1789181375.943244:0:8469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfcf5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:880710ad-110c-42a4-a174-ab1b99a7ebeb:8469:1876092510040448:0@lo:502: 00000100:00100000:1.0:1789181375.943290:0:8469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfcf5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:880710ad-110c-42a4-a174-ab1b99a7ebeb:8469:1876092510040576:0@lo:502: 00000100:00100000:1.0:1789181375.943355:0:8469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181375.943390:0:8469:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1c051a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789181375.944141:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510040576 00000100:00100000:2.0:1789181375.944149:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510040576 00000100:00100000:2.0:1789181375.944195:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1789181375.944205:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189957850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+13:8469:x1876092510040576:12345-0@lo:502: 00000100:00100000:2.0:1789181375.944656:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189957850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+13:8469:x1876092510040576:12345-0@lo:502: Request processed in 452us (1300us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181375.944665:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789181375.944896:0:8469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfcf5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:880710ad-110c-42a4-a174-ab1b99a7ebeb:8469:1876092510040576:0@lo:502: 00000040:00080000:1.0:1789181375.944926:0:8469:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1789181375.945263:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1789181375.945280:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789181375.945290:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc180031400/0x8f4f7840b2e41146 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e4114d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181375.945523:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.132@tcp lock: ffff9dc180031400/0x8f4f7840b2e41146 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e4114d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789181375.945534:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1789181375.945536:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1789181375.945539:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1789181375.945671:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc1ba784600/0x8f4f7840b2e41154 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181375.945681:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.132@tcp lock: ffff9dc1ba784600/0x8f4f7840b2e41154 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181375.945691:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.132@tcp lock: ffff9dc1ba784600/0x8f4f7840b2e41154 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181375.945709:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b66f7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510040704:0@lo:101: 00000100:00100000:2.0:1789181375.945837:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181375.945950:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1899d3000 going to sleep for 11 seconds 00000100:00100000:0.0:1789181375.946012:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510040704 00000100:00100000:0.0:1789181375.946019:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510040704 00000100:00100000:0.0:1789181375.946071:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789181375.946080:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189956450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+13:5840:x1876092510040704:12345-0@lo:101: 00010000:00010000:0.0:1789181375.946099:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181375.946112:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc180030600/0x8f4f7840b2e4115b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f4f7840b2e41154 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181375.946148:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc180030600/0x8f4f7840b2e4115b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f4f7840b2e41154 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181375.946159:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc180030600/0x8f4f7840b2e4115b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e41154 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181375.946168:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc180030600, rc 0) 00000100:00100000:0.0:1789181375.946200:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189956450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+14:5840:x1876092510040704:12345-0@lo:101: Request processed in 122us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181375.946207:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1789181375.946666:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b66f7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510040704:0@lo:101: 00010000:00010000:2.0:1789181375.946681:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.132@tcp lock: ffff9dc1ba784600/0x8f4f7840b2e41154 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e4115b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181375.946691:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.132@tcp lock: ffff9dc1ba784600/0x8f4f7840b2e41154 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f4f7840b2e4115b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181375.946739:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b66f7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510040832:0@lo:501: 00000100:00100000:2.0:1789181375.947110:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181375.947300:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1899d3000 going to sleep for 11 seconds 00000100:00100000:0.0:1789181375.947912:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510040832 00000100:00100000:0.0:1789181375.947919:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510040832 00000100:00100000:0.0:1789181375.947989:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789181375.947998:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189957050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+14:5840:x1876092510040832:12345-0@lo:501: 00000100:00100000:0.0:1789181375.948300:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189957050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+14:5840:x1876092510040832:12345-0@lo:501: Request processed in 302us (1188us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181375.948307:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789181375.948538:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b66f7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510040832:0@lo:501: 00000100:00100000:2.0:1789181375.948577:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b66f7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510040960:0@lo:503: 00000100:00100000:2.0:1789181375.948619:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181375.956674:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1899d3000 going to sleep for 11 seconds 00000100:00100000:0.0:1789181375.957038:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510040960 00000100:00100000:0.0:1789181375.957047:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510040960 00000100:00100000:0.0:1789181375.957088:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789181375.957099:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189954850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+14:5840:x1876092510040960:12345-0@lo:503: 00000100:00100000:0.0:1789181375.957381:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189954850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+14:5840:x1876092510040960:12345-0@lo:503: Request processed in 274us (8750us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181375.957390:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1789181375.960993:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b66f7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510040960:0@lo:503: 00000100:00100000:2.0:1789181375.961940:0:8470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b66f7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:880710ad-110c-42a4-a174-ab1b99a7ebeb:8470:1876092510041088:0@lo:502: 00000100:00100000:2.0:1789181375.962009:0:8470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181375.962058:0:8470:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1899d36c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789181375.962272:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510041088 00000100:00100000:0.0:1789181375.962280:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510041088 00000100:00100000:0.0:1789181375.962361:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789181375.962381:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189956050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+14:8470:x1876092510041088:12345-0@lo:502: 00000100:00100000:0.0:1789181375.962610:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189956050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+14:8470:x1876092510041088:12345-0@lo:502: Request processed in 238us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181375.962617:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789181375.963065:0:8470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b66f7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:880710ad-110c-42a4-a174-ab1b99a7ebeb:8470:1876092510041088:0@lo:502: 00000020:01000000:2.0:1789181375.963097:0:8470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789181375.963107:0:8470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789181375.963109:0:8470:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789181375.963115:0:8470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789181375.963153:0:8470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b66f7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:880710ad-110c-42a4-a174-ab1b99a7ebeb:8470:1876092510041216:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789181375.963191:0:8470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181375.963214:0:8470:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1bfb33900 going to sleep for 11 seconds 00000100:00100000:3.0:1789181375.963631:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510041216 00000100:00100000:3.0:1789181375.963638:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510041216 00000100:00100000:3.0:1789181375.963680:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789181375.963688:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189956850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+14:8470:x1876092510041216:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789181375.964036:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189956850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+14:8470:x1876092510041216:12345-0@lo:502:llog_process_th.0 Request processed in 337us (832us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181375.964043:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789181375.964301:0:8470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b66f7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:880710ad-110c-42a4-a174-ab1b99a7ebeb:8470:1876092510041216:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789181375.964359:0:8470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789181375.964366:0:8470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789181375.964368:0:8470:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789181375.964585:0:8470:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1789181375.964775:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1789181375.964793:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.132@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1789181375.964803:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc1ba784600/0x8f4f7840b2e41154 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e4115b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181375.964817:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.132@tcp lock: ffff9dc1ba784600/0x8f4f7840b2e41154 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e4115b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789181375.964827:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789181375.964830:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9dc189d1d800 from 39 10000000:01000000:0.0:1789181375.964832:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789181375.964985:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc180031e00/0x8f4f7840b2e41162 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181375.964994:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.132@tcp lock: ffff9dc180031e00/0x8f4f7840b2e41162 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181375.965005:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.132@tcp lock: ffff9dc180031e00/0x8f4f7840b2e41162 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181375.965036:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c026a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510041344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789181375.965075:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181375.965120:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1868f0540 going to sleep for 11 seconds 00000100:00100000:1.0:1789181375.965206:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510041344 00000100:00100000:1.0:1789181375.965212:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510041344 00000100:00100000:1.0:1789181375.965251:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789181375.965260:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189977850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+14:5840:x1876092510041344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789181375.965272:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181375.965282:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc1c2045000/0x8f4f7840b2e41169 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f4f7840b2e41162 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181375.965303:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc1c2045000/0x8f4f7840b2e41169 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f4f7840b2e41162 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181375.965369:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc1c2045000/0x8f4f7840b2e41169 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e41162 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181375.965387:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1c2045000, rc 0) 00000100:00100000:1.0:1789181375.965431:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189977850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+15:5840:x1876092510041344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 173us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181375.965438:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789181375.965721:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c026a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510041344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789181375.965735:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.132@tcp lock: ffff9dc180031e00/0x8f4f7840b2e41162 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e41169 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181375.965744:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.132@tcp lock: ffff9dc180031e00/0x8f4f7840b2e41162 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f4f7840b2e41169 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181375.965930:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c026a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510041472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789181375.965958:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181375.965992:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1868f0540 going to sleep for 11 seconds 00000100:00100000:3.0:1789181375.966063:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510041472 00000100:00100000:3.0:1789181375.966068:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510041472 00000100:00100000:3.0:1789181375.966102:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1789181375.966108:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189977050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+15:5840:x1876092510041472:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789181375.966659:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189977050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+15:5840:x1876092510041472:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 549us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181375.966674:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789181375.966962:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c026a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510041472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789181375.966999:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c026a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510041600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789181375.967041:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181375.967073:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1868f0540 going to sleep for 11 seconds 00000100:00100000:1.0:1789181375.967245:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510041600 00000100:00100000:1.0:1789181375.967250:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510041600 00000100:00100000:1.0:1789181375.967275:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789181375.967281:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189974850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+15:5840:x1876092510041600:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789181375.967664:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189974850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+15:5840:x1876092510041600:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 381us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181375.967672:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789181375.967778:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c026a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510041600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789181375.969014:0:8471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc19c36df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:880710ad-110c-42a4-a174-ab1b99a7ebeb:8471:1876092510041728:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789181375.971100:0:8471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181375.971161:0:8471:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1aa4c7540 going to sleep for 11 seconds 00000100:00100000:1.0:1789181375.971671:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510041728 00000100:00100000:1.0:1789181375.971680:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510041728 00000100:00100000:1.0:1789181375.971733:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1789181375.971742:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189976050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+15:8471:x1876092510041728:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789181375.972038:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189976050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+15:8471:x1876092510041728:12345-0@lo:502:llog_process_th.0 Request processed in 282us (930us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181375.972047:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789181375.972556:0:8471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc19c36df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:880710ad-110c-42a4-a174-ab1b99a7ebeb:8471:1876092510041728:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789181375.972625:0:8471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c0268e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:880710ad-110c-42a4-a174-ab1b99a7ebeb:8471:1876092510041856:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789181375.972667:0:8471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181375.972698:0:8471:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1868f0d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789181375.973096:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510041856 00000100:00100000:1.0:1789181375.973103:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510041856 00000100:00100000:1.0:1789181375.973550:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789181375.973562:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189976850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+15:8471:x1876092510041856:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789181375.974086:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189976850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+15:8471:x1876092510041856:12345-0@lo:502:llog_process_th.0 Request processed in 525us (1416us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181375.974095:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789181375.974527:0:8471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c0268e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:880710ad-110c-42a4-a174-ab1b99a7ebeb:8471:1876092510041856:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789181375.974560:0:8471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1789181375.974705:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1789181375.974726:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789181375.974736:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc180031e00/0x8f4f7840b2e41162 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e41169 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181375.974767:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.132@tcp lock: ffff9dc180031e00/0x8f4f7840b2e41162 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e41169 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789181375.974776:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1789181375.974779:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1789181375.974781:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789181375.974808:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc1ba784400/0x8f4f7840b2e41170 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181375.974816:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.132@tcp lock: ffff9dc1ba784400/0x8f4f7840b2e41170 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181375.974825:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.132@tcp lock: ffff9dc1ba784400/0x8f4f7840b2e41170 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181375.974850:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b66f7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510041984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789181375.974886:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181375.974921:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1bfb33900 going to sleep for 11 seconds 00000100:00100000:3.0:1789181375.975033:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510041984 00000100:00100000:3.0:1789181375.975040:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510041984 00000100:00100000:3.0:1789181375.975072:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789181375.975079:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189974050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+15:5840:x1876092510041984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789181375.975089:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181375.975101:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc1bfa1f200/0x8f4f7840b2e41177 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f4f7840b2e41170 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181375.975137:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc1bfa1f200/0x8f4f7840b2e41177 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f4f7840b2e41170 expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181375.975146:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc1bfa1f200/0x8f4f7840b2e41177 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e41170 expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181375.975155:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1bfa1f200, rc 0) 00000100:00100000:3.0:1789181375.975196:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189974050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+16:5840:x1876092510041984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181375.975201:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789181375.975369:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b66f7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510041984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789181375.975382:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.132@tcp lock: ffff9dc1ba784400/0x8f4f7840b2e41170 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e41177 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181375.975390:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.132@tcp lock: ffff9dc1ba784400/0x8f4f7840b2e41170 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f4f7840b2e41177 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181375.975449:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b66f7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510042112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789181375.975476:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181375.975504:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1bfb33900 going to sleep for 11 seconds 00000100:00100000:1.0:1789181375.976003:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510042112 00000100:00100000:1.0:1789181375.976009:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510042112 00000100:00100000:1.0:1789181375.976057:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789181375.976065:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189975c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+16:5840:x1876092510042112:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789181375.976942:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189975c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+16:5840:x1876092510042112:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 876us (1462us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181375.976951:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789181375.981299:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b66f7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510042112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789181375.981455:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c026b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510042240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789181375.981539:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181375.981585:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1868f0d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789181375.981611:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510042240 00000100:00100000:3.0:1789181375.981619:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510042240 00000100:00100000:3.0:1789181375.981673:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789181375.981691:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189974450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+16:5840:x1876092510042240:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789181375.981907:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189974450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+16:5840:x1876092510042240:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 217us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181375.981915:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789181375.981930:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c026b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510042240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789181375.983616:0:8472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc19c36d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:880710ad-110c-42a4-a174-ab1b99a7ebeb:8472:1876092510042368:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789181375.983684:0:8472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181375.983727:0:8472:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1aa4c70c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789181375.984549:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510042368 00000100:00100000:0.0:1789181375.984559:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510042368 00000100:00100000:0.0:1789181375.984606:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789181375.984616:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189976c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+16:8472:x1876092510042368:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789181375.984907:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189976c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+16:8472:x1876092510042368:12345-0@lo:502:llog_process_th.0 Request processed in 292us (1222us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181375.984915:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789181375.985885:0:8472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc19c36d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:880710ad-110c-42a4-a174-ab1b99a7ebeb:8472:1876092510042368:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789181375.985924:0:8472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789181375.985934:0:8472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789181375.985937:0:8472:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789181375.985942:0:8472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789181375.985979:0:8472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc19c36d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:880710ad-110c-42a4-a174-ab1b99a7ebeb:8472:1876092510042496:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789181375.986253:0:8472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181375.986297:0:8472:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1aa4c70c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789181375.986509:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510042496 00000100:00100000:2.0:1789181375.986516:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510042496 00000100:00100000:2.0:1789181375.986554:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789181375.986562:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189974c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+16:8472:x1876092510042496:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789181375.986896:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189974c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+16:8472:x1876092510042496:12345-0@lo:502:llog_process_th.0 Request processed in 334us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181375.986904:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789181375.988679:0:8472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc19c36d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:880710ad-110c-42a4-a174-ab1b99a7ebeb:8472:1876092510042496:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789181375.988727:0:8472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789181375.988736:0:8472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789181375.988739:0:8472:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789181375.988743:0:8472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:0.0:1789181375.989142:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:0.0:1789181375.989163:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.132@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789181375.989173:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc1ba784400/0x8f4f7840b2e41170 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e41177 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181375.989185:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.132@tcp lock: ffff9dc1ba784400/0x8f4f7840b2e41170 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e41177 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789181375.989196:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789181375.989198:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9dc1add60800 from 39 10000000:01000000:0.0:1789181375.989201:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789181375.989234:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc180030a00/0x8f4f7840b2e4117e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181375.989243:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.132@tcp lock: ffff9dc180030a00/0x8f4f7840b2e4117e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181375.989252:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.132@tcp lock: ffff9dc180030a00/0x8f4f7840b2e4117e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181375.989273:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c026b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510042624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789181375.989452:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181375.989630:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1868f0300 going to sleep for 11 seconds 00000100:00100000:1.0:1789181375.990302:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510042624 00000100:00100000:1.0:1789181375.990311:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510042624 00000100:00100000:1.0:1789181375.990638:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789181375.990650:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189975450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+16:5840:x1876092510042624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789181375.990665:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181375.990681:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc1c2045800/0x8f4f7840b2e41185 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f4f7840b2e4117e expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181375.990706:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc1c2045800/0x8f4f7840b2e41185 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f4f7840b2e4117e expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181375.990716:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc1c2045800/0x8f4f7840b2e41185 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e4117e expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181375.990725:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1c2045800, rc 0) 00000100:00100000:1.0:1789181375.990968:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189975450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+17:5840:x1876092510042624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 319us (1637us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181375.990988:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789181375.991264:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c026b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510042624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789181375.991281:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.132@tcp lock: ffff9dc180030a00/0x8f4f7840b2e4117e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e41185 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181375.991291:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.132@tcp lock: ffff9dc180030a00/0x8f4f7840b2e4117e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f4f7840b2e41185 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181375.991469:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c026b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510042752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789181375.991503:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181375.991570:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1868f0300 going to sleep for 11 seconds 00000100:00100000:1.0:1789181375.991641:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510042752 00000100:00100000:1.0:1789181375.991647:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510042752 00000100:00100000:1.0:1789181375.991682:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789181375.991689:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189975050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+17:5840:x1876092510042752:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789181375.992181:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189975050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+17:5840:x1876092510042752:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 491us (676us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181375.992189:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789181375.992380:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c026b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510042752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789181375.992427:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c026b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510042880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789181375.992465:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181375.992490:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1868f0300 going to sleep for 11 seconds 00000100:00100000:2.0:1789181375.992557:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510042880 00000100:00100000:2.0:1789181375.992562:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510042880 00000100:00100000:2.0:1789181375.992592:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789181375.992599:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189975850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+17:5840:x1876092510042880:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789181375.992739:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189975850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+17:5840:x1876092510042880:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 140us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181375.992757:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789181375.992877:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c026b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510042880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789181375.993471:0:8473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfcf5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:880710ad-110c-42a4-a174-ab1b99a7ebeb:8473:1876092510043008:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789181375.993511:0:8473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181375.993544:0:8473:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1c051a480 going to sleep for 11 seconds 00000100:00100000:2.0:1789181375.993635:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510043008 00000100:00100000:2.0:1789181375.993641:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510043008 00000100:00100000:2.0:1789181375.993671:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789181375.993679:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189976450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+17:8473:x1876092510043008:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789181375.994541:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189976450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+17:8473:x1876092510043008:12345-0@lo:502:llog_process_th.0 Request processed in 860us (1026us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181375.994550:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789181375.994657:0:8473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfcf5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:880710ad-110c-42a4-a174-ab1b99a7ebeb:8473:1876092510043008:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789181375.994710:0:8473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c026b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:880710ad-110c-42a4-a174-ab1b99a7ebeb:8473:1876092510043136:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789181375.994764:0:8473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181375.994795:0:8473:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1868f0540 going to sleep for 11 seconds 00000100:00100000:1.0:1789181375.994963:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510043136 00000100:00100000:1.0:1789181375.994970:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510043136 00000100:00100000:1.0:1789181375.994996:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789181375.995003:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189977450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+17:8473:x1876092510043136:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789181375.995464:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189977450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+17:8473:x1876092510043136:12345-0@lo:502:llog_process_th.0 Request processed in 459us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181375.995471:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789181375.995641:0:8473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c026b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:880710ad-110c-42a4-a174-ab1b99a7ebeb:8473:1876092510043136:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789181375.995669:0:8473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1789181375.996019:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1789181375.996102:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789181375.996112:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc180030a00/0x8f4f7840b2e4117e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e41185 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181375.996136:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.132@tcp lock: ffff9dc180030a00/0x8f4f7840b2e4117e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e41185 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789181375.996146:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789181375.996148:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1789181375.996151:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789181375.996175:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc1ba784e00/0x8f4f7840b2e4118c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181375.996182:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.132@tcp lock: ffff9dc1ba784e00/0x8f4f7840b2e4118c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181375.996191:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.132@tcp lock: ffff9dc1ba784e00/0x8f4f7840b2e4118c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181375.996209:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b66f6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510043264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789181375.996241:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181375.996315:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1bfb33540 going to sleep for 11 seconds 00000100:00100000:1.0:1789181375.996509:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510043264 00000100:00100000:1.0:1789181375.996516:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510043264 00000100:00100000:1.0:1789181375.996582:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789181375.996591:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189977c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+17:5840:x1876092510043264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789181375.996602:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181375.996614:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc1c2044600/0x8f4f7840b2e41193 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f4f7840b2e4118c expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181375.996648:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc1c2044600/0x8f4f7840b2e41193 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f4f7840b2e4118c expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181375.996659:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc1c2044600/0x8f4f7840b2e41193 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e4118c expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181375.996666:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1c2044600, rc 0) 00000100:00100000:1.0:1789181375.996712:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189977c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+18:5840:x1876092510043264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181375.996718:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789181375.996784:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b66f6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510043264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789181375.996799:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.132@tcp lock: ffff9dc1ba784e00/0x8f4f7840b2e4118c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e41193 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181375.996814:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.132@tcp lock: ffff9dc1ba784e00/0x8f4f7840b2e4118c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f4f7840b2e41193 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181375.996875:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c026b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510043392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789181375.996902:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181375.997206:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1868f0540 going to sleep for 11 seconds 00000100:00100000:2.0:1789181375.997275:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510043392 00000100:00100000:2.0:1789181375.997279:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510043392 00000100:00100000:2.0:1789181375.997303:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789181375.997310:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+18:5840:x1876092510043392:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789181375.997603:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+18:5840:x1876092510043392:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 293us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181375.997611:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789181375.997706:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c026b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510043392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789181375.997742:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c026b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510043520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789181375.997795:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181375.997822:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1868f0540 going to sleep for 11 seconds 00000100:00100000:2.0:1789181375.997986:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510043520 00000100:00100000:2.0:1789181375.997991:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510043520 00000100:00100000:2.0:1789181375.998012:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789181375.998106:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+18:5840:x1876092510043520:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789181375.998256:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+18:5840:x1876092510043520:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 231us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181375.998263:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789181375.998370:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c026b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510043520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789181375.998703:0:8474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c026b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:880710ad-110c-42a4-a174-ab1b99a7ebeb:8474:1876092510043648:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789181375.998740:0:8474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181375.998919:0:8474:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1868f03c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789181375.998968:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510043648 00000100:00100000:2.0:1789181375.998973:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510043648 00000100:00100000:2.0:1789181375.998996:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789181375.999003:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+18:8474:x1876092510043648:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789181375.999265:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+18:8474:x1876092510043648:12345-0@lo:502:llog_process_th.0 Request processed in 261us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181375.999272:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789181375.999373:0:8474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c026b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:880710ad-110c-42a4-a174-ab1b99a7ebeb:8474:1876092510043648:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789181375.999410:0:8474:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789181375.999419:0:8474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789181375.999421:0:8474:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789181375.999428:0:8474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1789181375.999449:0:8474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c026b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:880710ad-110c-42a4-a174-ab1b99a7ebeb:8474:1876092510043776:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789181375.999483:0:8474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181375.999502:0:8474:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1c051a480 going to sleep for 11 seconds 00000100:00100000:2.0:1789181375.999544:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510043776 00000100:00100000:2.0:1789181375.999548:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510043776 00000100:00100000:2.0:1789181375.999563:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789181375.999569:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c273050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+18:8474:x1876092510043776:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789181375.999693:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c273050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+18:8474:x1876092510043776:12345-0@lo:502:llog_process_th.0 Request processed in 123us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181375.999699:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789181375.999819:0:8474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c026b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:880710ad-110c-42a4-a174-ab1b99a7ebeb:8474:1876092510043776:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789181375.999910:0:8474:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789181375.999914:0:8474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789181375.999916:0:8474:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789181375.999920:0:8474:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1789181376.000317:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:2.0:1789181376.000359:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.132@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789181376.000368:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc1ba784e00/0x8f4f7840b2e4118c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e41193 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181376.000380:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.132@tcp lock: ffff9dc1ba784e00/0x8f4f7840b2e4118c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e41193 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789181376.000390:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1789181376.000409:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9dc18851cd40 from 1 10000000:01000000:2.0:1789181376.000412:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789181376.000434:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc1ba785000/0x8f4f7840b2e4119a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181376.000443:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.132@tcp lock: ffff9dc1ba785000/0x8f4f7840b2e4119a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181376.000451:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.132@tcp lock: ffff9dc1ba785000/0x8f4f7840b2e4119a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181376.000466:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b66f7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510043904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789181376.000495:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181376.000517:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1adcd6a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789181376.000591:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510043904 00000100:00100000:0.0:1789181376.000596:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510043904 00000100:00100000:0.0:1789181376.000617:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1789181376.000623:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+18:5840:x1876092510043904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789181376.000631:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181376.000644:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc180030c00/0x8f4f7840b2e411a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f4f7840b2e4119a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181376.000664:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc180030c00/0x8f4f7840b2e411a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f4f7840b2e4119a expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181376.000674:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc180030c00/0x8f4f7840b2e411a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e4119a expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181376.000682:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc180030c00, rc 0) 00000100:00100000:0.0:1789181376.000712:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:5840:x1876092510043904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 90us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181376.000718:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789181376.000805:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b66f7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510043904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789181376.000819:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.132@tcp lock: ffff9dc1ba785000/0x8f4f7840b2e4119a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e411a1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181376.000828:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.132@tcp lock: ffff9dc1ba785000/0x8f4f7840b2e4119a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f4f7840b2e411a1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181376.000997:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b66f7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510044032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789181376.001092:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181376.001123:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1adcd6a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789181376.001187:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510044032 00000100:00100000:1.0:1789181376.001192:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510044032 00000100:00100000:1.0:1789181376.001215:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1789181376.001222:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:5840:x1876092510044032:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789181376.001461:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:5840:x1876092510044032:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 238us (436us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789181376.001467:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789181376.001592:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b66f7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510044032:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1789181376.001614:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.132@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789181376.001621:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc1ba785000/0x8f4f7840b2e4119a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e411a1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181376.001640:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.132@tcp lock: ffff9dc1ba785000/0x8f4f7840b2e4119a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e411a1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181376.062867:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789181376.731460:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181376.731562:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092487996032 00000100:00100000:1.0:1789181376.731573:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092487996032 00000100:00100000:1.0:1789181376.731632:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 163 00000100:00100000:1.0:1789181376.731643:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:975a0591-a8f7-4a74-9f93-a5aa77f2315c+8:5594:x1876092487996032:12345-192.168.204.32@tcp:101: 00010000:00010000:1.0:1789181376.731659:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181376.731690:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc1c2044e00/0x8f4f7840b2e411a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91ef61 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181376.731727:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc1c2044e00/0x8f4f7840b2e411a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91ef61 expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181376.731751:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc1c2044e00/0x8f4f7840b2e411a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91ef61 expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181376.731760:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1c2044e00, rc 0) 00000100:00100000:1.0:1789181376.731820:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:975a0591-a8f7-4a74-9f93-a5aa77f2315c+9:5594:x1876092487996032:12345-192.168.204.32@tcp:101: Request processed in 180us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181376.731826:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 163 00000100:00100000:3.0:1789181376.754274:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181376.754670:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092487996160 00000100:00100000:0.0:1789181376.754680:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092487996160 00000100:00100000:0.0:1789181376.754806:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 164 00000100:00100000:0.0:1789181376.754816:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c270050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:975a0591-a8f7-4a74-9f93-a5aa77f2315c+9:5594:x1876092487996160:12345-192.168.204.32@tcp:501: 00000100:00100000:0.0:1789181376.757074:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c270050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:975a0591-a8f7-4a74-9f93-a5aa77f2315c+9:5594:x1876092487996160:12345-192.168.204.32@tcp:501: Request processed in 2240us (2791us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181376.757100:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 164 00000100:00100000:3.0:1789181376.787468:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181376.787627:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092487996288 00000100:00100000:2.0:1789181376.787637:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092487996288 00000100:00100000:2.0:1789181376.787689:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 165 00000100:00100000:2.0:1789181376.787698:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c270450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:975a0591-a8f7-4a74-9f93-a5aa77f2315c+9:5594:x1876092487996288:12345-192.168.204.32@tcp:503: 00000100:00100000:2.0:1789181376.787930:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c270450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:975a0591-a8f7-4a74-9f93-a5aa77f2315c+9:5594:x1876092487996288:12345-192.168.204.32@tcp:503: Request processed in 232us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181376.787944:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 165 00000100:00100000:3.0:1789181376.805010:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181376.805295:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092487996416 00000100:00100000:0.0:1789181376.805305:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092487996416 00000100:00100000:0.0:1789181376.805404:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 166 00000100:00100000:0.0:1789181376.805425:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c271c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:975a0591-a8f7-4a74-9f93-a5aa77f2315c+9:6071:x1876092487996416:12345-192.168.204.32@tcp:502: 00000100:00100000:0.0:1789181376.805716:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c271c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:975a0591-a8f7-4a74-9f93-a5aa77f2315c+9:6071:x1876092487996416:12345-192.168.204.32@tcp:502: Request processed in 302us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181376.805725:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 166 00000100:00100000:3.0:1789181376.811036:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181376.820155:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092487996544 00000100:00100000:1.0:1789181376.820172:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092487996544 00000100:00100000:1.0:1789181376.820249:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 167 00000100:00100000:1.0:1789181376.820260:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c272c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:975a0591-a8f7-4a74-9f93-a5aa77f2315c+9:6071:x1876092487996544:12345-192.168.204.32@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789181376.822204:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c272c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:975a0591-a8f7-4a74-9f93-a5aa77f2315c+9:6071:x1876092487996544:12345-192.168.204.32@tcp:502:llog_process_th.0 Request processed in 1937us (11169us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181376.822216:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 167 00000100:00100000:3.0:1789181376.827930:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181376.828241:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092487996672 00000100:00100000:2.0:1789181376.828252:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092487996672 00000100:00100000:2.0:1789181376.828309:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 168 00000100:00100000:2.0:1789181376.828319:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:975a0591-a8f7-4a74-9f93-a5aa77f2315c+9:5594:x1876092487996672:12345-192.168.204.32@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789181376.828364:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181376.828394:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc1ba784800/0x8f4f7840b2e411af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91ef68 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181376.828427:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc1ba784800/0x8f4f7840b2e411af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91ef68 expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181376.828439:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc1ba784800/0x8f4f7840b2e411af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91ef68 expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181376.828449:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1ba784800, rc 0) 00000100:00100000:2.0:1789181376.829124:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:975a0591-a8f7-4a74-9f93-a5aa77f2315c+10:5594:x1876092487996672:12345-192.168.204.32@tcp:101:ll_cfg_requeue.0 Request processed in 191us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181376.829151:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 168 00000100:00100000:3.0:1789181376.852069:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181376.853585:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092487996800 00000100:00100000:1.0:1789181376.853599:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092487996800 00000100:00100000:1.0:1789181376.853667:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 169 00000100:00100000:1.0:1789181376.853677:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:975a0591-a8f7-4a74-9f93-a5aa77f2315c+10:5594:x1876092487996800:12345-192.168.204.32@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789181376.854697:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:975a0591-a8f7-4a74-9f93-a5aa77f2315c+10:5594:x1876092487996800:12345-192.168.204.32@tcp:501:ll_cfg_requeue.0 Request processed in 1008us (2634us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789181376.854709:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 169 00010000:00010000:0.0:1789181377.092721:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181377.550727:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b66f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:880710ad-110c-42a4-a174-ab1b99a7ebeb:3304:1876092510044160:0@lo:400:kworker.0 00000100:00100000:0.0:1789181377.550802:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181377.550849:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b66f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1876092510044672:0@lo:400:kworker.0 00000100:00100000:0.0:1789181377.550875:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181377.550899:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789181377.550906:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b66f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876092510044544:0@lo:400:kworker.0 00000100:00100000:0.0:1789181377.550929:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181377.550967:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b66f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876092510044288:0@lo:400:kworker.0 00000100:00100000:1.0:1789181377.550997:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181377.551006:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b66f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1876092510044416:0@lo:400:kworker.0 00000100:00100000:1.0:1789181377.551016:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b66f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510044800:0@lo:400:kworker.0 00000100:00100000:0.0:1789181377.551029:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181377.551051:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181377.551059:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510044160 00000100:00100000:0.0:1789181377.551066:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510044160 00000100:00100000:0.0:1789181377.551112:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1789181377.551121:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:3304:x1876092510044160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181377.551169:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:3304:x1876092510044160:12345-0@lo:400:kworker.0 Request processed in 50us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181377.551175:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1789181377.551213:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510044672 00000100:00100000:0.0:1789181377.551216:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510044672 00000100:00100000:0.0:1789181377.551247:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510044288 00000100:00100000:0.0:1789181377.551260:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510044288 00000100:00100000:0.0:1789181377.551275:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510044416 00000100:00100000:0.0:1789181377.551277:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510044416 00000100:00100000:0.0:1789181377.551291:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789181377.551297:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c026b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876092510044672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181377.551328:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c026b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876092510044672:12345-0@lo:400:kworker.0 Request processed in 31us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181377.551353:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789181377.551376:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789181377.551396:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfcf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876092510044288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181377.551435:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfcf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876092510044288:12345-0@lo:400:kworker.0 Request processed in 53us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181377.551441:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789181377.551453:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789181377.551458:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c026ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876092510044416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181377.551509:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c026ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876092510044416:12345-0@lo:400:kworker.0 Request processed in 50us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181377.551515:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789181377.551544:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b66f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:880710ad-110c-42a4-a174-ab1b99a7ebeb:3304:1876092510044160:0@lo:400:kworker.0 00000100:00100000:3.0:1789181377.551545:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b66f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1876092510044416:0@lo:400:kworker.0 00000100:00100000:0.0:1789181377.551554:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b66f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1876092510044672:0@lo:400:kworker.0 00000100:00080000:0.0:1789181377.551569:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789181377.552504:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b66f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876092510044288:0@lo:400:kworker.0 00000100:00100000:3.0:1789181377.552668:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510044544 00000100:00100000:3.0:1789181377.552675:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510044544 00000100:00100000:3.0:1789181377.552840:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510044800 00000100:00100000:3.0:1789181377.552845:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510044800 00000100:00100000:3.0:1789181377.552870:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789181377.552878:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c0268a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1876092510044544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181377.552936:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c0268a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1876092510044544:12345-0@lo:400:kworker.0 Request processed in 60us (2006us total) trans 0 rc 0/0 00000100:00080000:1.0:1789181377.553040:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789181377.553044:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789181377.553058:0:6894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789181377.553065:0:6894:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfcf4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510044800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181377.553102:0:6894:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfcf4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510044800:12345-0@lo:400:kworker.0 Request processed in 38us (2050us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181377.553108:0:6894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1789181377.553119:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc1b66f5f80 x1876092510044544/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1789181377.553135:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc1b66f5180 x1876092510044800/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181377.553146:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b66f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510044800:0@lo:400:kworker.0 00000100:00100000:0.0:1789181377.553147:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b66f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876092510044544:0@lo:400:kworker.0 00000100:00100000:3.0:1789181377.553186:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000020:00000080:3.0:1789181377.913310:0:8511:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff290a2d20 20000000:00000080:3.0:1789181377.913356:0:8511:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9dc1ba4a5c00 uarg=0000000000000000 20000000:01000000:3.0:1789181377.913404:0:8511:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789181377.913410:0:8511:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789181377.913414:0:8511:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1789181377.914652:0:8512:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:3.0:1789181377.914803:0:8511:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:3.0:1789181377.919749:0:8511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:3.0:1789181377.919807:0:8511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:3.0:1789181377.919865:0:8511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:3.0:1789181377.919885:0:8511:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789181377.919905:0:8511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dc1bfa1fa00/0x8f4f7840b2e411b6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181377.919921:0:8511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dc180031800/0x8f4f7840b2e40f2b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e40f24 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181377.919928:0:8511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dc180031a00/0x8f4f7840b2e40f8d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e40f86 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181377.919934:0:8511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dc1c2175600/0x8f4f7840b2e41058 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e41051 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181377.919950:0:8511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dc180031c00/0x8f4f7840b2e41115 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91ef30 expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181377.919958:0:8511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9dc1bfa1fa00/0x8f4f7840b2e411b6 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181377.919994:0:8511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dc180031c00/0x8f4f7840b2e41115 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91ef30 expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181377.920010:0:8511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dc180031c00/0x8f4f7840b2e41115 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91ef30 expref: 9 pid: 5837 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181377.920024:0:8511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc19c36d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8511:1876092510044928:192.168.204.32@tcp:104: 00010000:00010000:3.0:1789181377.920767:0:8511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dc1c2175600/0x8f4f7840b2e41058 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8f4f7840b2e41051 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181377.920778:0:8511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dc1c2175600/0x8f4f7840b2e41058 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8f4f7840b2e41051 expref: 18 pid: 5836 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181377.920789:0:8511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc19c36d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8511:1876092510045056:0@lo:104: 00000100:00100000:3.0:1789181377.920834:0:8511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789181377.920874:0:8511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dc180031a00/0x8f4f7840b2e40f8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8f4f7840b2e40f86 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181377.920882:0:8511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dc180031a00/0x8f4f7840b2e40f8d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8f4f7840b2e40f86 expref: 18 pid: 5836 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181377.920890:0:8511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc19c36d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8511:1876092510045184:0@lo:104: 00000100:00100000:3.0:1789181377.920928:0:8511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789181377.921022:0:8511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dc180031800/0x8f4f7840b2e40f2b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8f4f7840b2e40f24 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181377.921031:0:8511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dc180031800/0x8f4f7840b2e40f2b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8f4f7840b2e40f24 expref: 18 pid: 5836 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181377.921038:0:8511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc19c36e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8511:1876092510045312:0@lo:104: 00000100:00100000:3.0:1789181377.921056:0:8511:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1aa4c7240 going to sleep for 11 seconds 00000100:00100000:3.0:1789181377.924754:0:5826:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789181377.924793:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181377.924811:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510045056 00000100:00100000:3.0:1789181377.924819:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510045056 00000100:00100000:3.0:1789181377.924859:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510045184 00000100:00100000:3.0:1789181377.924863:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510045184 00000100:00100000:3.0:1789181377.924873:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510045312 00000100:00100000:3.0:1789181377.924875:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510045312 00000100:00100000:3.0:1789181377.924887:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789181377.924896:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c36c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:880710ad-110c-42a4-a174-ab1b99a7ebeb+5:8511:x1876092510045056:12345-0@lo:104: 00010000:00010000:3.0:1789181377.924911:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.132@tcp lock: ffff9dc1c2045600/0x8f4f7840b2e41051 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f4f7840b2e41058 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181377.924996:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789181377.925003:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c36c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:880710ad-110c-42a4-a174-ab1b99a7ebeb+5:8511:x1876092510045056:12345-0@lo:104: Request processed in 108us (4169us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181377.925010:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789181377.925031:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789181377.925037:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1aa5d7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:880710ad-110c-42a4-a174-ab1b99a7ebeb+4:8511:x1876092510045184:12345-0@lo:104: 00010000:00010000:3.0:1789181377.925045:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.132@tcp lock: ffff9dc18151ae00/0x8f4f7840b2e40f86 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f4f7840b2e40f8d expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181377.925101:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789181377.925106:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1aa5d7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:880710ad-110c-42a4-a174-ab1b99a7ebeb+4:8511:x1876092510045184:12345-0@lo:104: Request processed in 70us (4179us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181377.925113:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789181377.925158:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789181377.925165:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c36f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:880710ad-110c-42a4-a174-ab1b99a7ebeb+3:8511:x1876092510045312:12345-0@lo:104: 00010000:00010000:3.0:1789181377.925173:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.132@tcp lock: ffff9dc18151b600/0x8f4f7840b2e40f24 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f4f7840b2e40f2b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181377.925199:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789181377.925204:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c36f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:880710ad-110c-42a4-a174-ab1b99a7ebeb+3:8511:x1876092510045312:12345-0@lo:104: Request processed in 40us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181377.925209:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1789181377.925323:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789181377.925376:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.132@tcp lock: ffff9dc1c2045600/0x8f4f7840b2e41051 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f4f7840b2e41058 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181377.925384:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1c2045600 already unused, calling callback (ffffffffc1b45c20) 10000000:00010000:1.0:1789181377.925387:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.132@tcp lock: ffff9dc1c2045600/0x8f4f7840b2e41051 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8f4f7840b2e41058 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181377.925396:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.132@tcp lock: ffff9dc1c2045600/0x8f4f7840b2e41051 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8f4f7840b2e41058 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789181377.925402:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.132@tcp lock: ffff9dc1c2045600/0x8f4f7840b2e41051 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8f4f7840b2e41058 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789181377.925408:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789181377.925449:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.132@tcp lock: ffff9dc1c2045600/0x8f4f7840b2e41051 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e41058 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181377.925456:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789181377.925477:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.132@tcp lock: ffff9dc1c2045600/0x8f4f7840b2e41051 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e41058 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181377.925484:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.132@tcp lock: ffff9dc1c2045600/0x8f4f7840b2e41051 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e41058 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181377.925499:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789181377.925502:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.132@tcp lock: ffff9dc18151ae00/0x8f4f7840b2e40f86 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f4f7840b2e40f8d expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181377.925507:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc18151ae00 already unused, calling callback (ffffffffc1b45c20) 10000000:00010000:1.0:1789181377.925510:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.132@tcp lock: ffff9dc18151ae00/0x8f4f7840b2e40f86 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8f4f7840b2e40f8d expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181377.925517:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.132@tcp lock: ffff9dc18151ae00/0x8f4f7840b2e40f86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8f4f7840b2e40f8d expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789181377.925523:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.132@tcp lock: ffff9dc18151ae00/0x8f4f7840b2e40f86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8f4f7840b2e40f8d expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789181377.925528:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789181377.925540:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.132@tcp lock: ffff9dc18151ae00/0x8f4f7840b2e40f86 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e40f8d expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181377.925547:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789181377.925562:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.132@tcp lock: ffff9dc18151ae00/0x8f4f7840b2e40f86 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e40f8d expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181377.925579:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.132@tcp lock: ffff9dc18151ae00/0x8f4f7840b2e40f86 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e40f8d expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181377.925588:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789181377.925591:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.132@tcp lock: ffff9dc18151b600/0x8f4f7840b2e40f24 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f4f7840b2e40f2b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181377.925597:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc18151b600 already unused, calling callback (ffffffffc1b45c20) 10000000:00010000:1.0:1789181377.925600:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.132@tcp lock: ffff9dc18151b600/0x8f4f7840b2e40f24 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8f4f7840b2e40f2b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181377.925606:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.132@tcp lock: ffff9dc18151b600/0x8f4f7840b2e40f24 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8f4f7840b2e40f2b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789181377.925613:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.132@tcp lock: ffff9dc18151b600/0x8f4f7840b2e40f24 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8f4f7840b2e40f2b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789181377.925618:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789181377.925632:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.132@tcp lock: ffff9dc18151b600/0x8f4f7840b2e40f24 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e40f2b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181377.925638:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789181377.925644:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.132@tcp lock: ffff9dc18151b600/0x8f4f7840b2e40f24 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e40f2b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181377.925650:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.132@tcp lock: ffff9dc18151b600/0x8f4f7840b2e40f24 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e40f2b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181377.925663:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181377.925670:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181377.925672:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181377.925681:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789181377.925694:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfcf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:880710ad-110c-42a4-a174-ab1b99a7ebeb:3305:1876092510045440:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789181377.925743:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181377.925783:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfcf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:880710ad-110c-42a4-a174-ab1b99a7ebeb:3303:1876092510045568:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789181377.925805:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181377.925822:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789181377.925827:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfcf7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:880710ad-110c-42a4-a174-ab1b99a7ebeb:3303:1876092510045696:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789181377.925845:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789181377.925880:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181377.925895:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510045440 00000100:00100000:1.0:1789181377.925900:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510045440 00010000:00010000:1.0:1789181377.925923:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dc1c2175600/0x8f4f7840b2e41058 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f4f7840b2e41051 expref: 19 pid: 5836 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181377.925945:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510045568 00000100:00100000:1.0:1789181377.925948:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510045568 00010000:00010000:1.0:1789181377.925960:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dc180031a00/0x8f4f7840b2e40f8d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f4f7840b2e40f86 expref: 20 pid: 5836 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181377.925975:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510045696 00000100:00100000:1.0:1789181377.925977:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510045696 00010000:00010000:1.0:1789181377.925987:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dc180031800/0x8f4f7840b2e40f2b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f4f7840b2e40f24 expref: 21 pid: 5836 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181377.925999:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789181377.926006:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfcf4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:880710ad-110c-42a4-a174-ab1b99a7ebeb+21:3305:x1876092510045440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789181377.926016:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789181377.926022:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dc1c2175600/0x8f4f7840b2e41058 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f4f7840b2e41051 expref: 21 pid: 5836 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181377.926038:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dc1c2175600/0x8f4f7840b2e41058 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8f4f7840b2e41051 expref: 21 pid: 5836 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181377.926054:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789181377.926083:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfcf4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:880710ad-110c-42a4-a174-ab1b99a7ebeb+21:3305:x1876092510045440:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181377.926090:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789181377.926105:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789181377.926111:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfcf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:880710ad-110c-42a4-a174-ab1b99a7ebeb+20:3303:x1876092510045568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789181377.926120:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789181377.926124:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dc180031a00/0x8f4f7840b2e40f8d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f4f7840b2e40f86 expref: 20 pid: 5836 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181377.926132:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dc180031a00/0x8f4f7840b2e40f8d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8f4f7840b2e40f86 expref: 20 pid: 5836 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181377.926142:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789181377.926168:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfcf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:880710ad-110c-42a4-a174-ab1b99a7ebeb+20:3303:x1876092510045568:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181377.926173:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789181377.926185:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789181377.926191:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfcf7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:3303:x1876092510045696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789181377.926199:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789181377.926203:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dc180031800/0x8f4f7840b2e40f2b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f4f7840b2e40f24 expref: 19 pid: 5836 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181377.926211:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dc180031800/0x8f4f7840b2e40f2b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8f4f7840b2e40f24 expref: 19 pid: 5836 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181377.926226:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789181377.926248:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfcf7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:3303:x1876092510045696:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181377.926255:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789181377.926292:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfcf7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:880710ad-110c-42a4-a174-ab1b99a7ebeb:3303:1876092510045696:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789181377.926300:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfcf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:880710ad-110c-42a4-a174-ab1b99a7ebeb:3303:1876092510045568:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789181377.926321:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfcf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:880710ad-110c-42a4-a174-ab1b99a7ebeb:3305:1876092510045440:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789181377.926842:0:8511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc1c2175600/0x8f4f7840b2e41058 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8f4f7840b2e41051 expref: 18 pid: 5836 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181377.926854:0:8511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc19c36d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8511:1876092510045056:0@lo:104: 00010000:00010000:2.0:1789181377.926864:0:8511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc180031a00/0x8f4f7840b2e40f8d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8f4f7840b2e40f86 expref: 17 pid: 5836 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181377.926871:0:8511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc19c36d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8511:1876092510045184:0@lo:104: 00010000:00010000:2.0:1789181377.926880:0:8511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc180031800/0x8f4f7840b2e40f2b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8f4f7840b2e40f24 expref: 16 pid: 5836 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181377.926887:0:8511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc19c36e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8511:1876092510045312:0@lo:104: 00000100:00100000:2.0:1789181377.937485:0:8511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc19c36d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8511:1876092510044928:192.168.204.32@tcp:104: 00010000:00010000:2.0:1789181377.937523:0:8511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9dc1bfa1fa00/0x8f4f7840b2e411b6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181377.945473:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181377.945603:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092487996928 00000100:00100000:1.0:1789181377.945614:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092487996928 00010000:00010000:1.0:1789181377.945654:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dc180031c00/0x8f4f7840b2e41115 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91ef30 expref: 10 pid: 5837 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181377.945697:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 24 00000100:00100000:1.0:1789181377.945707:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c36c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:975a0591-a8f7-4a74-9f93-a5aa77f2315c+10:2353:x1876092487996928:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789181377.945723:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789181377.945729:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dc180031c00/0x8f4f7840b2e41115 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91ef30 expref: 10 pid: 5837 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181377.945742:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dc180031c00/0x8f4f7840b2e41115 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91ef30 expref: 10 pid: 5837 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181377.945760:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc180031c00/0x8f4f7840b2e41115 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91ef30 expref: 10 pid: 5837 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181377.945778:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9dc1bfa1fa00/0x8f4f7840b2e411b6 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181377.945803:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc1bfa1fa00/0x8f4f7840b2e411b6 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181377.945819:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dc1bfa1fa00/0x8f4f7840b2e411b6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181377.945826:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dc1bfa1fa00/0x8f4f7840b2e411b6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181377.945833:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dc1bfa1fa00/0x8f4f7840b2e411b6 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181377.945839:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dc1bfa1fa00/0x8f4f7840b2e411b6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181377.945845:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1bfa1fa00 already unused, calling callback (ffffffffc152f9b0) 00010000:00010000:1.0:1789181377.945849:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dc1bfa1fa00/0x8f4f7840b2e411b6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181377.945857:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dc1bfa1fa00/0x8f4f7840b2e411b6 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181377.945879:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dc1bfa1fa00/0x8f4f7840b2e411b6 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181377.945890:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789181377.945938:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c36c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:975a0591-a8f7-4a74-9f93-a5aa77f2315c+9:2353:x1876092487996928:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 232us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181377.945945:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 24 00010000:00010000:3.0:1789181377.946178:0:8511:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9dc1bfa1fa00/0x8f4f7840b2e411b6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181377.946188:0:8511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dc1bfa1fa00/0x8f4f7840b2e411b6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181377.946194:0:8511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc1bfa1fa00/0x8f4f7840b2e411b6 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181378.048752:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfcf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510045824:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789181378.048821:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181378.048911:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510045824 00000100:00100000:1.0:1789181378.048938:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510045824 00000100:00100000:1.0:1789181378.048989:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789181378.048999:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c36c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510045824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789181378.049033:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789181378.051240:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c36c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510045824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2235us (2411us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181378.051253:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1789181378.055518:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc1bfcf5500 x1876092510045824/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181394 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181378.055561:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfcf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510045824:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789181378.114161:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789181378.711616:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181378.714499:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092487997056 00000100:00100000:0.0:1789181378.714510:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092487997056 00000100:00100000:0.0:1789181378.714609:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 171 00000100:00100000:0.0:1789181378.714621:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:975a0591-a8f7-4a74-9f93-a5aa77f2315c+9:5594:x1876092487997056:12345-192.168.204.32@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789181378.714641:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181378.714671:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc180031600/0x8f4f7840b2e411bd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91ef6f expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181378.714697:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc180031600/0x8f4f7840b2e411bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91ef6f expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181378.714709:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc180031600/0x8f4f7840b2e411bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91ef6f expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181378.714718:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc180031600, rc 0) 00000100:00100000:0.0:1789181378.714775:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:975a0591-a8f7-4a74-9f93-a5aa77f2315c+10:5594:x1876092487997056:12345-192.168.204.32@tcp:101:ll_cfg_requeue.0 Request processed in 156us (3167us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181378.714782:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 171 00000100:00100000:0.0:1789181378.727435:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181378.727518:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092487997184 00000100:00100000:1.0:1789181378.727528:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092487997184 00000100:00100000:1.0:1789181378.727582:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 172 00000100:00100000:1.0:1789181378.727592:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:975a0591-a8f7-4a74-9f93-a5aa77f2315c+10:5594:x1876092487997184:12345-192.168.204.32@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789181378.727904:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:975a0591-a8f7-4a74-9f93-a5aa77f2315c+10:5594:x1876092487997184:12345-192.168.204.32@tcp:501:ll_cfg_requeue.0 Request processed in 312us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181378.727913:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 172 00000100:00100000:1.0:1789181378.730149:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181378.730400:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092487997312 00000100:00100000:0.0:1789181378.730412:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092487997312 00000100:00100000:0.0:1789181378.730458:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 173 00000100:00100000:0.0:1789181378.730477:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c371c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:975a0591-a8f7-4a74-9f93-a5aa77f2315c+10:5594:x1876092487997312:12345-192.168.204.32@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789181378.731045:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c371c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:975a0591-a8f7-4a74-9f93-a5aa77f2315c+10:5594:x1876092487997312:12345-192.168.204.32@tcp:503:ll_cfg_requeue.0 Request processed in 568us (904us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181378.731054:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 173 00000100:00100000:0.0:1789181378.734892:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181378.735283:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092487997440 00000100:00100000:2.0:1789181378.735294:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092487997440 00000100:00100000:2.0:1789181378.735373:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 174 00000100:00100000:2.0:1789181378.735385:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c370450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:975a0591-a8f7-4a74-9f93-a5aa77f2315c+10:6124:x1876092487997440:12345-192.168.204.32@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789181378.735967:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c370450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:975a0591-a8f7-4a74-9f93-a5aa77f2315c+10:6124:x1876092487997440:12345-192.168.204.32@tcp:502:llog_process_th.0 Request processed in 582us (1079us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181378.735975:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 174 00000100:00100000:0.0:1789181378.746868:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181378.748239:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092487997568 00000100:00100000:2.0:1789181378.748254:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092487997568 00000100:00100000:2.0:1789181378.748318:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 175 00000100:00100000:2.0:1789181378.748354:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c372c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:975a0591-a8f7-4a74-9f93-a5aa77f2315c+10:6124:x1876092487997568:12345-192.168.204.32@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789181378.748617:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c372c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:975a0591-a8f7-4a74-9f93-a5aa77f2315c+10:6124:x1876092487997568:12345-192.168.204.32@tcp:502:llog_process_th.0 Request processed in 287us (1756us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181378.748625:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 175 00010000:00010000:1.0:1789181379.136633:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789181379.646561:0:5840:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789181379.646571:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9dc08132f800 from 4 10000000:01000000:2.0:1789181379.646577:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789181379.646632:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc1ba785800/0x8f4f7840b2e411c4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181379.646645:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.132@tcp lock: ffff9dc1ba785800/0x8f4f7840b2e411c4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181379.646657:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.132@tcp lock: ffff9dc1ba785800/0x8f4f7840b2e411c4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181379.646683:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b66f7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510045952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789181379.646757:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181379.646825:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1b6b7e180 going to sleep for 11 seconds 00000100:00100000:3.0:1789181379.647122:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510045952 00000100:00100000:3.0:1789181379.647131:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510045952 00000100:00100000:3.0:1789181379.647183:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1789181379.647193:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c370c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+16:5840:x1876092510045952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789181379.647207:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181379.647223:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc1bfa1f800/0x8f4f7840b2e411cb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f4f7840b2e411c4 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181379.647248:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc1bfa1f800/0x8f4f7840b2e411cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f4f7840b2e411c4 expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181379.647259:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc1bfa1f800/0x8f4f7840b2e411cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e411c4 expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181379.647268:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1bfa1f800, rc 0) 00000100:00100000:3.0:1789181379.647323:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c370c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+17:5840:x1876092510045952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181379.647373:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1789181379.647613:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b66f7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510045952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789181379.647631:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.132@tcp lock: ffff9dc1ba785800/0x8f4f7840b2e411c4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e411cb expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181379.647641:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.132@tcp lock: ffff9dc1ba785800/0x8f4f7840b2e411c4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f4f7840b2e411cb expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181379.647704:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b66f7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510046080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789181379.647742:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181379.647765:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1b6b7e180 going to sleep for 11 seconds 00000100:00100000:3.0:1789181379.648129:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510046080 00000100:00100000:3.0:1789181379.648134:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510046080 00000100:00100000:3.0:1789181379.648171:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1789181379.648180:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c371450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+17:5840:x1876092510046080:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789181379.648660:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c371450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+17:5840:x1876092510046080:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 481us (916us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181379.648677:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1789181379.649249:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b66f7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510046080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789181379.649300:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c0269c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510046208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789181379.649376:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181379.649417:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1b6472b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789181379.651118:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510046208 00000100:00100000:2.0:1789181379.651133:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510046208 00000100:00100000:2.0:1789181379.651208:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1789181379.651219:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c371050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+17:5840:x1876092510046208:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789181379.652399:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c371050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+17:5840:x1876092510046208:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1177us (3017us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181379.652420:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1789181379.655032:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c0269c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510046208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789181379.656282:0:8581:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b66f4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:880710ad-110c-42a4-a174-ab1b99a7ebeb:8581:1876092510046336:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789181379.656998:0:8581:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181379.657060:0:8581:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1b6b7e180 going to sleep for 11 seconds 00000100:00100000:3.0:1789181379.657167:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510046336 00000100:00100000:3.0:1789181379.657175:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510046336 00000100:00100000:3.0:1789181379.657231:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1789181379.657240:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c371850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+17:8581:x1876092510046336:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789181379.657533:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c371850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+17:8581:x1876092510046336:12345-0@lo:502:llog_process_th.0 Request processed in 294us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181379.657542:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1789181379.657584:0:8581:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b66f4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:880710ad-110c-42a4-a174-ab1b99a7ebeb:8581:1876092510046336:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789181379.657630:0:8581:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789181379.657641:0:8581:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789181379.657643:0:8581:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789181379.657651:0:8581:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dc08132f800 00000020:00000080:1.0:1789181379.657654:0:8581:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789181379.657746:0:8581:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfcf6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:880710ad-110c-42a4-a174-ab1b99a7ebeb:8581:1876092510046464:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789181379.657785:0:8581:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181379.660165:0:8581:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1c03e7d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789181379.662500:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510046464 00000100:00100000:2.0:1789181379.662526:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510046464 00000100:00100000:2.0:1789181379.662585:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1789181379.662713:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c372450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+17:8581:x1876092510046464:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789181379.662976:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c372450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+17:8581:x1876092510046464:12345-0@lo:502:llog_process_th.0 Request processed in 382us (5189us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181379.662985:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1789181379.663593:0:8581:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfcf6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:880710ad-110c-42a4-a174-ab1b99a7ebeb:8581:1876092510046464:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789181379.663642:0:8581:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789181379.663650:0:8581:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789181379.663652:0:8581:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1789181379.663657:0:8581:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1789181379.663846:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1789181379.663866:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789181379.663877:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc1ba785800/0x8f4f7840b2e411c4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e411cb expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181379.663888:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.132@tcp lock: ffff9dc1ba785800/0x8f4f7840b2e411c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e411cb expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789181379.663909:0:5840:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789181379.663911:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9dc189d1d800 from 4 10000000:01000000:2.0:1789181379.663914:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789181379.663945:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc1ba785a00/0x8f4f7840b2e411d2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181379.663953:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.132@tcp lock: ffff9dc1ba785a00/0x8f4f7840b2e411d2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181379.663962:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.132@tcp lock: ffff9dc1ba785a00/0x8f4f7840b2e411d2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181379.663983:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b66f4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510046592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789181379.664025:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181379.664066:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc199c9e300 going to sleep for 11 seconds 00000100:00100000:3.0:1789181379.664208:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510046592 00000100:00100000:3.0:1789181379.664214:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510046592 00000100:00100000:3.0:1789181379.664255:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1789181379.664262:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c373450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+17:5840:x1876092510046592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789181379.664274:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181379.664287:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc1bfa1fa00/0x8f4f7840b2e411d9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f4f7840b2e411d2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181379.664308:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc1bfa1fa00/0x8f4f7840b2e411d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f4f7840b2e411d2 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181379.664318:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc1bfa1fa00/0x8f4f7840b2e411d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e411d2 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181379.664353:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1bfa1fa00, rc 0) 00000100:00100000:3.0:1789181379.664387:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c373450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+18:5840:x1876092510046592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181379.664394:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1789181379.666800:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b66f4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510046592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789181379.666829:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.132@tcp lock: ffff9dc1ba785a00/0x8f4f7840b2e411d2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e411d9 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181379.666841:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.132@tcp lock: ffff9dc1ba785a00/0x8f4f7840b2e411d2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f4f7840b2e411d9 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181379.666929:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfcf6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510046720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789181379.666986:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181379.667035:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1b6b7e180 going to sleep for 11 seconds 00000100:00100000:3.0:1789181379.667197:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510046720 00000100:00100000:3.0:1789181379.667212:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510046720 00000100:00100000:3.0:1789181379.667267:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1789181379.667276:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c373c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+18:5840:x1876092510046720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789181379.667579:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c373c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+18:5840:x1876092510046720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 304us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181379.667586:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1789181379.670289:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181379.670433:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181379.670467:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181379.670490:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181379.670525:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092487998080 00000100:00100000:3.0:1789181379.670534:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092487998080 00000100:00100000:3.0:1789181379.670588:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092487997952 00000100:00100000:3.0:1789181379.670591:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092487997952 00000100:00100000:3.0:1789181379.670619:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 17 00000100:00100000:3.0:1789181379.670629:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c36f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+5:2353:x1876092487998080:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:3.0:1789181379.670695:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c36f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+5:2353:x1876092487998080:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 68us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181379.670703:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 17 00000100:00100000:3.0:1789181379.670721:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 18 00000100:00100000:3.0:1789181379.670728:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c36e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+5:2353:x1876092487997952:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:3.0:1789181379.670753:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c36e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+5:2353:x1876092487997952:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 26us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181379.670759:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 18 00000100:00080000:3.0:1789181379.670778:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789181379.670782:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789181379.671151:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfcf6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510046720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789181379.671209:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfcf6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510046848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789181379.671261:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181379.671292:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1b6b7e180 going to sleep for 11 seconds 00000100:00100000:2.0:1789181379.671832:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092487997824 00000100:00100000:2.0:1789181379.671841:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092487997824 00000100:00100000:2.0:1789181379.671911:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 31 00000100:00100000:2.0:1789181379.671920:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c36ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+6:2353:x1876092487997824:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:2.0:1789181379.671963:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c36ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+6:2353:x1876092487997824:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 45us (1685us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181379.671970:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 31 00000100:00100000:2.0:1789181379.671996:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092487997696 00000100:00100000:2.0:1789181379.672000:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092487997696 00000100:00100000:2.0:1789181379.672019:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510046848 00000100:00100000:2.0:1789181379.672021:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510046848 00000100:00100000:2.0:1789181379.672033:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 183 00000100:00100000:2.0:1789181379.672039:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c373850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:975a0591-a8f7-4a74-9f93-a5aa77f2315c+10:2353:x1876092487997696:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:2.0:1789181379.672074:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c373850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:975a0591-a8f7-4a74-9f93-a5aa77f2315c+10:2353:x1876092487997696:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 34us (1606us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181379.672080:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 183 00000100:00100000:2.0:1789181379.672101:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1789181379.672108:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c373050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+18:5840:x1876092510046848:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789181379.672306:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c373050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+18:5840:x1876092510046848:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 198us (1045us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181379.672313:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00080000:1.0:1789181379.673406:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789181379.673580:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfcf6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510046848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789181379.674973:0:8583:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc19c36d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:880710ad-110c-42a4-a174-ab1b99a7ebeb:8583:1876092510046976:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789181379.675039:0:8583:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181379.675080:0:8583:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1aa4c7480 going to sleep for 11 seconds 00000100:00100000:2.0:1789181379.675454:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510046976 00000100:00100000:2.0:1789181379.675461:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510046976 00000100:00100000:2.0:1789181379.675504:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1789181379.675513:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c370850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+18:8583:x1876092510046976:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789181379.675735:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c370850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+18:8583:x1876092510046976:12345-0@lo:502:llog_process_th.0 Request processed in 223us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181379.675743:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1789181379.676493:0:8583:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc19c36d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:880710ad-110c-42a4-a174-ab1b99a7ebeb:8583:1876092510046976:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789181379.676527:0:8583:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789181379.676538:0:8583:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789181379.676540:0:8583:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789181379.676546:0:8583:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dc189d1d800 00000020:00000080:0.0:1789181379.676549:0:8583:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789181379.677283:0:8583:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c0269c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:880710ad-110c-42a4-a174-ab1b99a7ebeb:8583:1876092510047104:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789181379.677411:0:8583:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181379.677442:0:8583:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1b6472480 going to sleep for 11 seconds 00000100:00100000:2.0:1789181379.678114:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510047104 00000100:00100000:2.0:1789181379.678122:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510047104 00000100:00100000:2.0:1789181379.678186:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1789181379.678198:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c372050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+18:8583:x1876092510047104:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789181379.678615:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c372050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+18:8583:x1876092510047104:12345-0@lo:502:llog_process_th.0 Request processed in 417us (1201us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181379.678623:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1789181379.678949:0:8583:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c0269c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:880710ad-110c-42a4-a174-ab1b99a7ebeb:8583:1876092510047104:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789181379.678983:0:8583:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789181379.678991:0:8583:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789181379.678993:0:8583:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1789181379.678997:0:8583:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1789181379.679457:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1789181379.679483:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789181379.679493:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc1ba785a00/0x8f4f7840b2e411d2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e411d9 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181379.679504:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.132@tcp lock: ffff9dc1ba785a00/0x8f4f7840b2e411d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e411d9 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789181379.679515:0:5840:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789181379.679518:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9dc1add60800 from 4 10000000:01000000:2.0:1789181379.679520:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789181379.679548:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc1ba785200/0x8f4f7840b2e411e0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181379.679557:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.132@tcp lock: ffff9dc1ba785200/0x8f4f7840b2e411e0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181379.679566:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.132@tcp lock: ffff9dc1ba785200/0x8f4f7840b2e411e0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181379.679585:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b66f5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510047232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789181379.679622:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181379.681228:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc189ab7b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789181379.685986:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510047232 00000100:00100000:3.0:1789181379.686001:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510047232 00000100:00100000:3.0:1789181379.686078:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1789181379.686090:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c372850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+18:5840:x1876092510047232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789181379.686107:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181379.686126:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc1bfa1fc00/0x8f4f7840b2e411e7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f4f7840b2e411e0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181379.686155:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc1bfa1fc00/0x8f4f7840b2e411e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f4f7840b2e411e0 expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181379.686167:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc1bfa1fc00/0x8f4f7840b2e411e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e411e0 expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181379.686176:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1bfa1fc00, rc 0) 00000100:00100000:3.0:1789181379.686267:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c372850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:5840:x1876092510047232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 179us (6644us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181379.686274:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1789181379.687058:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b66f5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510047232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789181379.687087:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.132@tcp lock: ffff9dc1ba785200/0x8f4f7840b2e411e0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e411e7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181379.687099:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.132@tcp lock: ffff9dc1ba785200/0x8f4f7840b2e411e0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f4f7840b2e411e7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181379.687183:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc19c36e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510047360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789181379.687233:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181379.688127:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1aa4c7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789181379.691963:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510047360 00000100:00100000:0.0:1789181379.691987:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510047360 00000100:00100000:3.0:1789181379.697552:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1789181379.697567:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c370050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:5840:x1876092510047360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789181379.697872:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c370050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:5840:x1876092510047360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 308us (10638us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181379.697880:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1789181379.697942:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc19c36e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510047360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789181379.697998:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc19c36e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510047488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789181379.698045:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181379.698074:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1aa4c7cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789181379.698094:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510047488 00000100:00100000:3.0:1789181379.698101:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510047488 00000100:00100000:3.0:1789181379.698121:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1789181379.698127:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc18683f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:5840:x1876092510047488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789181379.698279:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc18683f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:5840:x1876092510047488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 150us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181379.698286:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1789181379.698317:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc19c36e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510047488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789181379.715780:0:8586:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b66f4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:880710ad-110c-42a4-a174-ab1b99a7ebeb:8586:1876092510047616:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789181379.715874:0:8586:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181379.715930:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510047616 00000100:00100000:2.0:1789181379.715938:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510047616 00000100:00100000:2.0:1789181379.715981:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1789181379.715990:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc18683f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:8586:x1876092510047616:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789181379.716197:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc18683f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:8586:x1876092510047616:12345-0@lo:502:llog_process_th.0 Request processed in 207us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181379.716212:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1789181379.716262:0:8586:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc189ab7180 going to sleep for 11 seconds 00000100:00100000:2.0:1789181379.716284:0:8586:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b66f4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:880710ad-110c-42a4-a174-ab1b99a7ebeb:8586:1876092510047616:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789181379.716309:0:8586:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789181379.716319:0:8586:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789181379.716321:0:8586:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789181379.716360:0:8586:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dc1add60800 00000020:00000080:2.0:1789181379.716364:0:8586:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789181379.718023:0:8586:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b66f4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:880710ad-110c-42a4-a174-ab1b99a7ebeb:8586:1876092510047744:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789181379.718085:0:8586:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181379.718118:0:8586:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc19c38da80 going to sleep for 11 seconds 00000100:00100000:1.0:1789181379.721488:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510047744 00000100:00100000:1.0:1789181379.721503:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510047744 00000100:00100000:1.0:1789181379.721559:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1789181379.721571:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc18683c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:8586:x1876092510047744:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789181379.721829:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc18683c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:8586:x1876092510047744:12345-0@lo:502:llog_process_th.0 Request processed in 261us (3742us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181379.721837:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1789181379.726163:0:8586:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b66f4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:880710ad-110c-42a4-a174-ab1b99a7ebeb:8586:1876092510047744:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789181379.726212:0:8586:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789181379.726221:0:8586:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789181379.726224:0:8586:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1789181379.726229:0:8586:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1789181379.726550:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1789181379.726576:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789181379.726588:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc1ba785200/0x8f4f7840b2e411e0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e411e7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181379.726599:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.132@tcp lock: ffff9dc1ba785200/0x8f4f7840b2e411e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e411e7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181380.162646:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181380.608475:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc19c36e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876092510047872:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789181380.608550:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181380.608725:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510047872 00000100:00100000:2.0:1789181380.608733:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510047872 00000100:00100000:2.0:1789181380.608795:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789181380.608818:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfcf7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876092510047872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789181380.608855:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1789181380.608997:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789181380.616109:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfcf7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876092510047872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 7284us (7548us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181380.616924:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1789181380.617027:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc19c36e680 x1876092510047872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181396 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181380.617053:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc19c36e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876092510047872:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789181381.183029:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181382.209094:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789181382.664276:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b66f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:880710ad-110c-42a4-a174-ab1b99a7ebeb:3303:1876092510048000:0@lo:400:kworker.0 00000100:00100000:0.0:1789181382.664459:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b66f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1876092510048256:0@lo:400:kworker.0 00000100:00100000:1.0:1789181382.664644:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b66f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876092510048128:0@lo:400:kworker.0 00000100:00100000:0.0:1789181382.664735:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181382.664794:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789181382.664802:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b66f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510048384:0@lo:400:kworker.0 00000100:00100000:0.0:1789181382.664829:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181382.664867:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510048256 00000100:00100000:0.0:1789181382.664875:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510048256 00000100:00100000:0.0:1789181382.664935:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789181382.664947:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c0269c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876092510048256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181382.664999:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c0269c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876092510048256:12345-0@lo:400:kworker.0 Request processed in 55us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181382.665005:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789181382.665029:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510048384 00000100:00100000:0.0:1789181382.665033:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510048384 00000100:00100000:0.0:1789181382.665060:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789181382.665066:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c026bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510048384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181382.665097:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c026bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510048384:12345-0@lo:400:kworker.0 Request processed in 32us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181382.665102:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:0.0:1789181382.665118:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789181382.665122:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789181382.665150:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc1b66f6300 x1876092510048384/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181398 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181382.665163:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b66f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510048384:0@lo:400:kworker.0 00000100:00100000:0.0:1789181382.665173:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b66f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1876092510048256:0@lo:400:kworker.0 00000100:00100000:1.0:1789181382.667543:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181382.667597:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b66f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876092510048640:0@lo:400:kworker.0 00000100:00100000:1.0:1789181382.667633:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181382.667699:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510048640 00000100:00100000:1.0:1789181382.667707:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510048640 00000100:00100000:1.0:1789181382.667761:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789181382.667770:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfcf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1876092510048640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181382.667821:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfcf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1876092510048640:12345-0@lo:400:kworker.0 Request processed in 52us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181382.667828:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:1.0:1789181382.667848:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789181382.667875:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc1b66f7800 x1876092510048640/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181398 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181382.667889:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b66f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876092510048640:0@lo:400:kworker.0 00000100:00100000:3.0:1789181382.668061:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181382.668180:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510048128 00000100:00100000:2.0:1789181382.668185:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510048128 00000100:00100000:2.0:1789181382.668222:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789181382.668238:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfcf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876092510048128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181382.668289:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfcf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876092510048128:12345-0@lo:400:kworker.0 Request processed in 53us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181382.668295:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789181382.668324:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b66f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1876092510048512:0@lo:400:kworker.0 00000100:00100000:1.0:1789181382.668479:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510048000 00000100:00100000:1.0:1789181382.668483:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510048000 00000100:00100000:1.0:1789181382.668511:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1789181382.668524:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189956c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:3303:x1876092510048000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181382.668556:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189956c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:3303:x1876092510048000:12345-0@lo:400:kworker.0 Request processed in 34us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181382.668562:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1789181382.668599:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b66f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876092510048128:0@lo:400:kworker.0 00000100:00100000:2.0:1789181382.668665:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181382.668697:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b66f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:880710ad-110c-42a4-a174-ab1b99a7ebeb:3303:1876092510048000:0@lo:400:kworker.0 00000100:00100000:3.0:1789181382.668771:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510048512 00000100:00100000:3.0:1789181382.668775:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510048512 00000100:00100000:3.0:1789181382.668821:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789181382.668829:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b66f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876092510048512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181382.668865:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b66f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876092510048512:12345-0@lo:400:kworker.0 Request processed in 38us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181382.668871:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789181382.668899:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b66f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1876092510048512:0@lo:400:kworker.0 00000100:00080000:2.0:1789181382.668945:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789181383.166725:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfcf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510048768:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789181383.166796:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181383.166923:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510048768 00000100:00100000:1.0:1789181383.166932:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510048768 00000100:00100000:1.0:1789181383.166986:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789181383.166996:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c0268380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510048768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789181383.167029:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789181383.167077:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c0268380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510048768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181383.167085:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1789181383.167123:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc1bfcf7800 x1876092510048768/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181399 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181383.167138:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfcf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510048768:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789181383.231090:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181384.256318:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181384.798384:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181384.798422:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181384.798515:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092487998336 00000100:00100000:0.0:1789181384.798525:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092487998336 00000100:00100000:0.0:1789181384.798588:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 35 00000100:00100000:0.0:1789181384.798599:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b66f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+6:2353:x1876092487998336:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:0.0:1789181384.798665:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b66f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+6:2353:x1876092487998336:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 69us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181384.798672:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 35 00000100:00100000:2.0:1789181384.800519:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181384.800569:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181384.800615:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092487998208 00000100:00100000:0.0:1789181384.800623:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092487998208 00000100:00100000:0.0:1789181384.800678:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 193 00000100:00100000:0.0:1789181384.800688:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189954c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:975a0591-a8f7-4a74-9f93-a5aa77f2315c+10:2353:x1876092487998208:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:0.0:1789181384.800750:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189954c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:975a0591-a8f7-4a74-9f93-a5aa77f2315c+10:2353:x1876092487998208:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 64us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181384.800757:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 193 00000100:00100000:3.0:1789181384.820617:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092487998592 00000100:00100000:3.0:1789181384.820631:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092487998592 00000100:00100000:3.0:1789181384.820699:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092487998464 00000100:00100000:3.0:1789181384.820703:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092487998464 00000100:00100000:3.0:1789181384.820737:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 21 00000100:00100000:3.0:1789181384.820748:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b66f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+5:2353:x1876092487998592:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:3.0:1789181384.820820:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b66f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+5:2353:x1876092487998592:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 74us (22397us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181384.820827:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 21 00000100:00100000:3.0:1789181384.820843:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 22 00000100:00100000:3.0:1789181384.820851:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b66f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+5:2353:x1876092487998464:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:3.0:1789181384.820875:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b66f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+5:2353:x1876092487998464:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 25us (20306us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181384.820881:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 22 00000100:00080000:3.0:1789181384.821043:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789181384.821047:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789181384.821050:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:3.0:1789181384.911844:0:8811:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg432-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:0.0:1789181385.278979:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181385.728754:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b66f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876092510048896:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789181385.728889:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181385.732241:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510048896 00000100:00100000:1.0:1789181385.733432:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510048896 00000100:00100000:1.0:1789181385.733508:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789181385.733520:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b66f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876092510048896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789181385.733559:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789181385.733647:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b66f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876092510048896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (4757us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181385.733654:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1789181385.733714:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc1b66f5880 x1876092510048896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181401 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181385.733734:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b66f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876092510048896:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789181385.734230:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789181386.302508:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181387.331063:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181387.781625:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789181387.781687:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789181387.781707:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b66f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876092510049152:0@lo:400:kworker.0 00000100:00100000:3.0:1789181387.781772:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181387.781850:0:6887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510049152 00000100:00100000:3.0:1789181387.781857:0:6887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510049152 00000100:00100000:3.0:1789181387.781905:0:6887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789181387.781915:0:6887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c36d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876092510049152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181387.781963:0:6887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c36d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876092510049152:12345-0@lo:400:kworker.0 Request processed in 49us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181387.781971:0:6887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789181387.782010:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b66f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876092510049152:0@lo:400:kworker.0 00000100:00100000:1.0:1789181387.786609:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b66f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:880710ad-110c-42a4-a174-ab1b99a7ebeb:3304:1876092510049024:0@lo:400:kworker.0 00000100:00100000:1.0:1789181387.786687:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181387.786958:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510049024 00000100:00100000:3.0:1789181387.786967:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510049024 00000100:00100000:3.0:1789181387.787024:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1789181387.787034:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189955450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:3304:x1876092510049024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181387.787091:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189955450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:3304:x1876092510049024:12345-0@lo:400:kworker.0 Request processed in 58us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181387.787098:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1789181387.789646:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b66f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:880710ad-110c-42a4-a174-ab1b99a7ebeb:3304:1876092510049024:0@lo:400:kworker.0 00000100:00100000:1.0:1789181387.794671:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b66f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1876092510049280:0@lo:400:kworker.0 00000100:00100000:1.0:1789181387.794804:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181387.794888:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789181387.794894:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b66f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510049408:0@lo:400:kworker.0 00000100:00100000:1.0:1789181387.794921:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181387.794958:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510049408 00000100:00100000:3.0:1789181387.794962:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510049280 00000100:00100000:3.0:1789181387.794966:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510049280 00000100:00100000:1.0:1789181387.794966:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510049408 00000100:00100000:3.0:1789181387.795021:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789181387.795032:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfcf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876092510049280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181387.795080:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfcf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876092510049280:12345-0@lo:400:kworker.0 Request processed in 50us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181387.795099:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789181387.795350:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789181387.795359:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfcf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510049408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181387.795390:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfcf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510049408:12345-0@lo:400:kworker.0 Request processed in 33us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181387.795396:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:1.0:1789181387.795433:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc1b66f5c00 x1876092510049408/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181403 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181387.795446:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b66f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510049408:0@lo:400:kworker.0 00000100:00100000:1.0:1789181387.795457:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b66f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1876092510049280:0@lo:400:kworker.0 00000100:00100000:1.0:1789181387.795478:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b66f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876092510049664:0@lo:400:kworker.0 00000100:00100000:1.0:1789181387.795512:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181387.795535:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789181387.795540:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b66f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1876092510049536:0@lo:400:kworker.0 00000100:00100000:1.0:1789181387.795559:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181387.795588:0:6887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510049536 00000100:00100000:1.0:1789181387.795592:0:6887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510049536 00000100:00100000:1.0:1789181387.795618:0:6887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789181387.795625:0:6887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfcf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876092510049536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181387.795661:0:6887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfcf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876092510049536:12345-0@lo:400:kworker.0 Request processed in 37us (101us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181387.795667:0:6887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789181387.795690:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b66f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1876092510049536:0@lo:400:kworker.0 00000100:00100000:2.0:1789181387.796684:0:6894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510049664 00000100:00100000:2.0:1789181387.796691:0:6894:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510049664 00000100:00100000:2.0:1789181387.797183:0:6894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789181387.797193:0:6894:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfcf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1876092510049664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181387.797252:0:6894:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfcf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1876092510049664:12345-0@lo:400:kworker.0 Request processed in 61us (1739us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181387.797258:0:6894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:1.0:1789181387.797424:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc1b66f4e00 x1876092510049664/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181403 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181387.797436:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b66f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876092510049664:0@lo:400:kworker.0 00000100:00080000:3.0:1789181387.804168:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789181387.804317:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789181387.804321:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789181388.286853:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789181388.286877:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c0269f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876092510049792:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789181388.286949:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181388.287046:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510049792 00000100:00100000:0.0:1789181388.287055:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510049792 00000100:00100000:0.0:1789181388.287112:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789181388.287122:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b66f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876092510049792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789181388.287159:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789181388.287232:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b66f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876092510049792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181388.287255:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1789181388.287306:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc1c0269f80 x1876092510049792/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181404 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181388.287325:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c0269f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876092510049792:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789181388.359153:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181389.376535:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181389.913711:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181389.913830:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092487998720 00000100:00100000:3.0:1789181389.913842:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092487998720 00000100:00100000:3.0:1789181389.913892:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 195 00000100:00100000:3.0:1789181389.913901:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189955050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:975a0591-a8f7-4a74-9f93-a5aa77f2315c+10:2354:x1876092487998720:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:3.0:1789181389.913967:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189955050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:975a0591-a8f7-4a74-9f93-a5aa77f2315c+10:2354:x1876092487998720:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 68us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181389.913975:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 195 00000100:00100000:2.0:1789181389.916688:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181389.916768:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092487998848 00000100:00100000:3.0:1789181389.916778:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092487998848 00000100:00100000:3.0:1789181389.916885:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 39 00000100:00100000:3.0:1789181389.916896:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b66f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+6:2354:x1876092487998848:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:3.0:1789181389.916971:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b66f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+6:2354:x1876092487998848:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 77us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181389.916979:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 39 00000100:00080000:2.0:1789181389.922185:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789181389.922429:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181389.922602:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092487998976 00000100:00100000:3.0:1789181389.922613:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092487998976 00000100:00100000:2.0:1789181389.922670:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181389.922678:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 10 00000100:00100000:2.0:1789181389.922842:0:6894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092487999104 00000100:00100000:2.0:1789181389.922847:0:6894:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092487999104 00000100:00100000:2.0:1789181389.922885:0:6894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 11 00000100:00100000:2.0:1789181389.922893:0:6894:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b66f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+5:2350:x1876092487999104:12345-192.168.204.32@tcp:9:kworker.0 00000100:00100000:3.0:1789181389.922918:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b66f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+5:2350:x1876092487998976:12345-192.168.204.32@tcp:9:kworker.0 00000020:00000080:2.0:1789181389.922928:0:6894:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8f4f7840b2e4112a 00000100:00080000:2.0:1789181389.922939:0:6894:0:(import.c:65:import_set_state_nolock()) ffff9dc1aa5c5000 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1789181389.922944:0:6692:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8f4f7840b2e41123 00000100:00080000:3.0:1789181389.922954:0:6692:0:(import.c:65:import_set_state_nolock()) ffff9dc1878b6000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789181389.922980:0:6894:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000001:00000004:3.0:1789181389.922988:0:6692:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1789181389.923416:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b66f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+2:2350:x1876092487998976:12345-192.168.204.32@tcp:9:kworker.0 Request processed in 727us (992us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181389.923425:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 10 00010000:00010000:3.0:1789181389.923492:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181389.923563:0:6894:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b66f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+2:2350:x1876092487999104:12345-192.168.204.32@tcp:9:kworker.0 Request processed in 670us (895us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181389.923572:0:6894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 11 00010000:00010000:2.0:1789181389.923618:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789181389.923854:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789181389.923858:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789181390.408608:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789181390.775246:0:9056:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg432-server.virtnet: executing yml_node 00000100:00100000:3.0:1789181390.850989:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789181390.851014:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc19c36d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510049920:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789181390.851087:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181390.851172:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510049920 00000100:00100000:3.0:1789181390.851180:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510049920 00000100:00100000:3.0:1789181390.851244:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789181390.851255:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c36df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510049920:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789181390.851274:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1789181390.851298:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789181390.851364:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c36df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510049920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181390.851372:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:2.0:1789181390.851905:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc19c36d180 x1876092510049920/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181406 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181390.851927:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc19c36d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510049920:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789181391.423115:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181392.446525:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181392.896677:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b66f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1876092510050304:0@lo:400:kworker.0 00000100:00100000:0.0:1789181392.896746:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181392.896820:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789181392.896827:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b66f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510050432:0@lo:400:kworker.0 00000100:00100000:0.0:1789181392.896852:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181392.896905:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510050432 00000100:00100000:0.0:1789181392.896913:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510050432 00000100:00100000:0.0:1789181392.896974:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789181392.896982:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c0269880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510050432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181392.897031:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c0269880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510050432:12345-0@lo:400:kworker.0 Request processed in 50us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181392.897038:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:0.0:1789181392.897060:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789181392.897097:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc1b66f5880 x1876092510050432/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181392.897112:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b66f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510050432:0@lo:400:kworker.0 00000100:00100000:3.0:1789181392.897241:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b66f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:880710ad-110c-42a4-a174-ab1b99a7ebeb:3303:1876092510050048:0@lo:400:kworker.0 00000100:00100000:3.0:1789181392.897277:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181392.897311:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c026d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1876092510050560:0@lo:400:kworker.0 00000100:00100000:3.0:1789181392.897359:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181392.897376:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789181392.897382:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b66f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876092510050176:0@lo:400:kworker.0 00000100:00100000:3.0:1789181392.897402:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181392.897418:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc18854b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876092510050688:0@lo:400:kworker.0 00000100:00100000:3.0:1789181392.897436:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181392.897457:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510050688 00000100:00100000:3.0:1789181392.897473:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510050688 00000100:00100000:3.0:1789181392.897502:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789181392.897508:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c36e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1876092510050688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181392.897545:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c36e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1876092510050688:12345-0@lo:400:kworker.0 Request processed in 38us (108us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181392.897551:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789181392.897570:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510050304 00000100:00100000:3.0:1789181392.897574:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510050304 00000100:00100000:3.0:1789181392.897598:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510050560 00000100:00100000:3.0:1789181392.897601:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510050560 00000100:00100000:3.0:1789181392.897613:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510050176 00000100:00100000:3.0:1789181392.897615:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510050176 00000100:00100000:3.0:1789181392.897625:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789181392.897631:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c0269f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876092510050304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181392.897662:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c0269f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876092510050304:12345-0@lo:400:kworker.0 Request processed in 31us (916us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181392.897667:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789181392.897677:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789181392.897682:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c36c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876092510050560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181392.897704:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c36c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876092510050560:12345-0@lo:400:kworker.0 Request processed in 23us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181392.897710:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789181392.897719:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789181392.897723:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c36d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876092510050176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181392.897745:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c36d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876092510050176:12345-0@lo:400:kworker.0 Request processed in 22us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181392.897749:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789181392.897784:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b66f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876092510050176:0@lo:400:kworker.0 00010000:00080000:3.0:1789181392.897794:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc18854b800 x1876092510050688/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181392.897803:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc18854b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876092510050688:0@lo:400:kworker.0 00000100:00100000:3.0:1789181392.897812:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c026d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1876092510050560:0@lo:400:kworker.0 00000100:00100000:0.0:1789181392.898360:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510050048 00000100:00100000:0.0:1789181392.898366:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510050048 00000100:00100000:0.0:1789181392.898412:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1789181392.898419:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189955850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:3303:x1876092510050048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181392.898471:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189955850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:3303:x1876092510050048:12345-0@lo:400:kworker.0 Request processed in 53us (1193us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181392.898477:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00080000:0.0:1789181392.898502:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789181392.898506:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789181392.898528:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b66f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1876092510050304:0@lo:400:kworker.0 00000100:00100000:2.0:1789181392.898601:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b66f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:880710ad-110c-42a4-a174-ab1b99a7ebeb:3303:1876092510050048:0@lo:400:kworker.0 00000100:00100000:2.0:1789181393.406712:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c0269180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510050816:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789181393.406799:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181393.408202:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510050816 00000100:00100000:3.0:1789181393.408215:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510050816 00000100:00100000:3.0:1789181393.408361:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789181393.408372:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc188548000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510050816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789181393.408431:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789181393.408502:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc188548000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510050816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 131us (1701us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181393.408509:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:0.0:1789181393.408574:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc1c0269180 x1876092510050816/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181409 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181393.408594:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c0269180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510050816:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789181393.472238:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181394.497963:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789181394.502073:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5971a429-48ca-4c07-88a3-fa58102a53bc 00000020:00000080:0.0:1789181394.502092:0:7647:0:(genops.c:885:class_export_put()) final put ffff9dc1aa5c2800/5971a429-48ca-4c07-88a3-fa58102a53bc 00000020:00000080:0.0:1789181394.502120:0:54:0:(genops.c:844:class_export_destroy()) destroying export ffff9dc1aa5c2800/5971a429-48ca-4c07-88a3-fa58102a53bc for lustre-OST0001 00000020:00000080:0.0:1789181394.502159:0:54:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9dc1aa5c5000 for lustre-OST0001 00000001:00100000:3.0:1789181395.024568:0:6718:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5971a429-48ca-4c07-88a3-fa58102a53bc 00000020:00000080:3.0:1789181395.024578:0:6718:0:(genops.c:885:class_export_put()) final put ffff9dc1878b0800/5971a429-48ca-4c07-88a3-fa58102a53bc 00000020:00000080:3.0:1789181395.024607:0:252:0:(genops.c:844:class_export_destroy()) destroying export ffff9dc1878b0800/5971a429-48ca-4c07-88a3-fa58102a53bc for lustre-OST0000 00000020:00000080:3.0:1789181395.024649:0:252:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9dc1878b6000 for lustre-OST0000 00000100:00100000:2.0:1789181395.032435:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181395.032473:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181395.032776:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092487999232 00000100:00100000:3.0:1789181395.032787:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092487999232 00000100:00100000:3.0:1789181395.032848:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 197 00000100:00100000:3.0:1789181395.032860:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189957450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:975a0591-a8f7-4a74-9f93-a5aa77f2315c+10:2354:x1876092487999232:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:3.0:1789181395.032935:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189957450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:975a0591-a8f7-4a74-9f93-a5aa77f2315c+10:2354:x1876092487999232:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 78us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181395.032942:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 197 00000100:00100000:0.0:1789181395.033078:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092487999360 00000100:00100000:0.0:1789181395.033083:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092487999360 00000100:00100000:0.0:1789181395.033141:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 43 00000100:00100000:0.0:1789181395.033150:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc188548e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+6:2354:x1876092487999360:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:0.0:1789181395.033192:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc188548e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+6:2354:x1876092487999360:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 44us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181395.033198:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 43 00000100:00080000:3.0:1789181395.033778:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789181395.518869:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789181395.602300:0:9252:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.39 00000100:00100000:0.0:1789181395.973362:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc19c36d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876092510050944:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789181395.973439:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181395.973576:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510050944 00000100:00100000:2.0:1789181395.973586:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510050944 00000100:00100000:2.0:1789181395.973645:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789181395.973655:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c0269180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876092510050944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789181395.973703:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1789181395.973793:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789181395.979884:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c0269180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876092510050944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 6214us (6427us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181395.979901:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1789181395.980874:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc19c36d880 x1876092510050944/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181411 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181395.980903:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc19c36d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876092510050944:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789181396.542796:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181397.574024:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181398.014867:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc188549880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:880710ad-110c-42a4-a174-ab1b99a7ebeb:3303:1876092510051072:0@lo:400:kworker.0 00000100:00100000:2.0:1789181398.014951:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181398.015019:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc18854b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1876092510051584:0@lo:400:kworker.0 00000100:00100000:2.0:1789181398.015045:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181398.015071:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789181398.015077:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc188548700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876092510051200:0@lo:400:kworker.0 00000100:00100000:2.0:1789181398.015097:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181398.015114:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfa2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876092510051712:0@lo:400:kworker.0 00000100:00100000:2.0:1789181398.015137:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181398.015168:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510051072 00000100:00100000:2.0:1789181398.015175:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510051072 00000100:00100000:2.0:1789181398.015220:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1789181398.015228:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189957c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:3303:x1876092510051072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181398.015275:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189957c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:3303:x1876092510051072:12345-0@lo:400:kworker.0 Request processed in 47us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181398.015282:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1789181398.015325:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510051584 00000100:00100000:2.0:1789181398.015349:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510051584 00000100:00100000:2.0:1789181398.015381:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510051200 00000100:00100000:2.0:1789181398.015384:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510051200 00000100:00100000:2.0:1789181398.015404:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789181398.015410:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfa2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876092510051584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181398.015443:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfa2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876092510051584:12345-0@lo:400:kworker.0 Request processed in 33us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181398.015463:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789181398.015475:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789181398.015481:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfa2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876092510051200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181398.015508:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfa2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876092510051200:12345-0@lo:400:kworker.0 Request processed in 28us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181398.015514:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789181398.015555:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc188548700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876092510051200:0@lo:400:kworker.0 00000100:00100000:2.0:1789181398.015566:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc188549880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:880710ad-110c-42a4-a174-ab1b99a7ebeb:3303:1876092510051072:0@lo:400:kworker.0 00000100:00100000:2.0:1789181398.015575:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc18854b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1876092510051584:0@lo:400:kworker.0 00000100:00100000:0.0:1789181398.015985:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc18854bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876092510051456:0@lo:400:kworker.0 00000100:00100000:0.0:1789181398.016021:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181398.016054:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789181398.016061:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc188549c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1876092510051328:0@lo:400:kworker.0 00000100:00100000:0.0:1789181398.016081:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181398.016110:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510051712 00000100:00100000:0.0:1789181398.016114:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510051712 00000100:00100000:0.0:1789181398.016146:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510051456 00000100:00100000:0.0:1789181398.016149:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510051456 00000100:00100000:0.0:1789181398.016172:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789181398.016180:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfa2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1876092510051712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181398.016216:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfa2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1876092510051712:12345-0@lo:400:kworker.0 Request processed in 38us (1078us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181398.016222:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789181398.016234:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789181398.016240:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c0268700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876092510051456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181398.016270:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c0268700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876092510051456:12345-0@lo:400:kworker.0 Request processed in 30us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181398.016276:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789181398.016293:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510051328 00000100:00100000:0.0:1789181398.016296:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510051328 00000100:00100000:0.0:1789181398.016323:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789181398.016357:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c0269500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876092510051328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181398.016401:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c0269500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876092510051328:12345-0@lo:400:kworker.0 Request processed in 73us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181398.016407:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789181398.016457:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc188549c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1876092510051328:0@lo:400:kworker.0 00010000:00080000:0.0:1789181398.016471:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc18854bb80 x1876092510051456/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181414 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181398.016482:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc18854bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876092510051456:0@lo:400:kworker.0 00010000:00080000:2.0:1789181398.016626:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc1bfa2f480 x1876092510051712/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181414 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181398.016636:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfa2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876092510051712:0@lo:400:kworker.0 00000100:00080000:3.0:1789181398.016774:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789181398.016790:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789181398.016793:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789181398.533016:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfa2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510051840:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789181398.533093:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181398.533235:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510051840 00000100:00100000:2.0:1789181398.533245:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510051840 00000100:00100000:2.0:1789181398.533304:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789181398.533313:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c026a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510051840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789181398.533379:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789181398.533439:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c026a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510051840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 127us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181398.533447:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1789181398.534084:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc1bfa2f480 x1876092510051840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181414 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181398.534105:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfa2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510051840:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789181398.590882:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789181399.002534:0:9349:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.39 00010000:00010000:2.0:1789181399.615293:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181400.154449:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181400.154504:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181400.154539:0:6887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092487999616 00000100:00100000:2.0:1789181400.154550:0:6887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092487999616 00000100:00100000:2.0:1789181400.154713:0:6887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 47 00000100:00100000:2.0:1789181400.154725:0:6887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfa2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+6:2354:x1876092487999616:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:2.0:1789181400.154795:0:6887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfa2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+6:2354:x1876092487999616:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 73us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181400.154802:0:6887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 47 00000100:00100000:1.0:1789181400.156108:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092487999488 00000100:00100000:1.0:1789181400.156119:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092487999488 00000100:00100000:1.0:1789181400.156163:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 199 00000100:00100000:1.0:1789181400.156172:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189957850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:975a0591-a8f7-4a74-9f93-a5aa77f2315c+10:2354:x1876092487999488:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:1.0:1789181400.156231:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189957850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:975a0591-a8f7-4a74-9f93-a5aa77f2315c+10:2354:x1876092487999488:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 60us (1792us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181400.156249:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 199 00000100:00080000:3.0:1789181400.158041:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789181400.640578:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181401.089290:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc19c36d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876092510051968:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789181401.089387:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181401.090594:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510051968 00000100:00100000:2.0:1789181401.090606:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510051968 00000100:00100000:2.0:1789181401.090677:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789181401.090688:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c026b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876092510051968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789181401.090729:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789181401.090809:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c026b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876092510051968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (1420us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181401.090817:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1789181401.091209:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789181401.091426:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc19c36d880 x1876092510051968/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181417 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181401.091448:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc19c36d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876092510051968:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789181401.662806:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789181402.344557:0:9448:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.39 00010000:00010000:1.0:1789181402.687253:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181403.134673:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfa2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:880710ad-110c-42a4-a174-ab1b99a7ebeb:3303:1876092510052096:0@lo:400:kworker.0 00000100:00100000:2.0:1789181403.134752:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181403.134954:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfa2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876092510052224:0@lo:400:kworker.0 00000100:00100000:1.0:1789181403.134991:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181403.135040:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfa2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876092510052736:0@lo:400:kworker.0 00000100:00100000:1.0:1789181403.135065:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181403.135115:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510052736 00000100:00100000:1.0:1789181403.135123:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510052736 00000100:00100000:1.0:1789181403.135179:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789181403.135189:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfcf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876092510052736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181403.135239:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfcf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876092510052736:12345-0@lo:400:kworker.0 Request processed in 52us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181403.135247:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1789181403.135268:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789181403.135297:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc1bfa2fb80 x1876092510052736/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181419 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181403.135310:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfa2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876092510052736:0@lo:400:kworker.0 00000100:00100000:1.0:1789181403.135392:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510052096 00000100:00100000:1.0:1789181403.135396:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510052096 00000100:00100000:1.0:1789181403.135421:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1789181403.135427:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189956450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:3303:x1876092510052096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181403.135628:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfa2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876092510052480:0@lo:400:kworker.0 00000100:00100000:3.0:1789181403.135661:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181403.135683:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789181403.135689:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfa2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1876092510052352:0@lo:400:kworker.0 00000100:00100000:3.0:1789181403.135712:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181403.135736:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510052480 00000100:00100000:3.0:1789181403.135740:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510052480 00000100:00100000:3.0:1789181403.135788:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789181403.135798:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c36d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876092510052480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181403.135836:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c36d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876092510052480:12345-0@lo:400:kworker.0 Request processed in 41us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181403.135843:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:3.0:1789181403.135867:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc1bfa2ed80 x1876092510052480/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181419 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181403.135888:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfa2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876092510052480:0@lo:400:kworker.0 00000100:00100000:0.0:1789181403.136483:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510052224 00000100:00100000:0.0:1789181403.136489:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510052224 00000100:00100000:0.0:1789181403.136534:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510052352 00000100:00100000:0.0:1789181403.136538:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510052352 00000100:00100000:0.0:1789181403.136561:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789181403.136568:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfcf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876092510052224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181403.136616:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfcf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876092510052224:12345-0@lo:400:kworker.0 Request processed in 49us (1625us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181403.136622:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789181403.136646:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789181403.136653:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c026d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876092510052352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181403.136689:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c026d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876092510052352:12345-0@lo:400:kworker.0 Request processed in 37us (976us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181403.136695:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789181403.136732:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfa2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1876092510052352:0@lo:400:kworker.0 00000100:00080000:0.0:1789181403.136766:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789181403.136769:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789181403.136807:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfa2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876092510052224:0@lo:400:kworker.0 00000100:00100000:1.0:1789181403.138704:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189956450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:3303:x1876092510052096:12345-0@lo:400:kworker.0 Request processed in 3270us (3945us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181403.138715:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1789181403.139724:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfa2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:880710ad-110c-42a4-a174-ab1b99a7ebeb:3303:1876092510052096:0@lo:400:kworker.0 00000100:00100000:2.0:1789181403.139740:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfa2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1876092510052608:0@lo:400:kworker.0 00000100:00100000:2.0:1789181403.139824:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181403.140145:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510052608 00000100:00100000:0.0:1789181403.140152:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510052608 00000100:00100000:0.0:1789181403.140227:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789181403.140237:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfa2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876092510052608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181403.140301:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfa2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876092510052608:12345-0@lo:400:kworker.0 Request processed in 67us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181403.140309:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789181403.140414:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfa2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1876092510052608:0@lo:400:kworker.0 00000100:00080000:1.0:1789181403.140695:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789181403.652672:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789181403.652693:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfa2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876092510052864:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789181403.652756:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181403.652968:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510052864 00000100:00100000:2.0:1789181403.652977:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510052864 00000100:00100000:2.0:1789181403.653056:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789181403.653066:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfcf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876092510052864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789181403.653098:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789181403.653144:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfcf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876092510052864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181403.653151:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1789181403.653217:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc1bfa2ce00 x1876092510052864/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181419 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181403.653236:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfa2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876092510052864:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789181403.710685:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789181403.999180:0:9496:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Fri Sep 11 22:50:03 EDT 2026 00010000:00010000:1.0:1789181404.737490:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181405.277173:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181405.277224:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181405.277255:0:6887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092487999872 00000100:00100000:0.0:1789181405.277266:0:6887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092487999872 00000100:00100000:0.0:1789181405.277327:0:6887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 51 00000100:00100000:0.0:1789181405.277363:0:6887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c0268e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+6:2354:x1876092487999872:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:0.0:1789181405.277434:0:6887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c0268e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+6:2354:x1876092487999872:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 76us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181405.277442:0:6887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 51 00000100:00100000:1.0:1789181405.277495:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092487999744 00000100:00100000:1.0:1789181405.277500:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092487999744 00000100:00100000:1.0:1789181405.277539:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 201 00000100:00100000:1.0:1789181405.277547:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189957050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:975a0591-a8f7-4a74-9f93-a5aa77f2315c+10:2354:x1876092487999744:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:1.0:1789181405.277576:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189957050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:975a0591-a8f7-4a74-9f93-a5aa77f2315c+10:2354:x1876092487999744:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 30us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181405.277582:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 201 00000100:00080000:1.0:1789181405.277608:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789181405.762518:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181406.212481:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789181406.212503:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfb2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510052992:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789181406.212570:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181406.212680:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510052992 00000100:00100000:3.0:1789181406.212688:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510052992 00000100:00100000:3.0:1789181406.212750:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789181406.212760:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c026a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510052992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789181406.212802:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789181406.212863:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c026a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510052992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181406.212870:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1789181406.212909:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc1bfb2e680 x1876092510052992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181422 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181406.212926:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfb2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510052992:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789181406.212985:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789181406.786324:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181407.816941:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181408.254735:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfa2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876092510053248:0@lo:400:kworker.0 00000100:00100000:0.0:1789181408.254825:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181408.254889:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfa2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876092510053760:0@lo:400:kworker.0 00000100:00100000:0.0:1789181408.254927:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181408.254957:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789181408.254963:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfa2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:880710ad-110c-42a4-a174-ab1b99a7ebeb:3304:1876092510053120:0@lo:400:kworker.0 00000100:00100000:0.0:1789181408.254991:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181408.255011:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfa2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1876092510053632:0@lo:400:kworker.0 00000100:00100000:0.0:1789181408.255032:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181408.255159:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510053248 00000100:00100000:0.0:1789181408.255167:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510053248 00000100:00100000:0.0:1789181408.255217:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510053632 00000100:00100000:0.0:1789181408.255221:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510053632 00000100:00100000:0.0:1789181408.255253:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789181408.255262:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c026b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876092510053248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181408.255288:0:6887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789181408.255302:0:6887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b66f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876092510053632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181408.255316:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c026b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876092510053248:12345-0@lo:400:kworker.0 Request processed in 55us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181408.255323:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:0.0:1789181408.255366:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789181408.255375:0:6887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b66f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876092510053632:12345-0@lo:400:kworker.0 Request processed in 78us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181408.255383:0:6887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789181408.255404:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfa2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1876092510053632:0@lo:400:kworker.0 00000100:00100000:0.0:1789181408.255418:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfa2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876092510053248:0@lo:400:kworker.0 00000100:00100000:1.0:1789181408.256034:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfa2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1876092510053376:0@lo:400:kworker.0 00000100:00100000:1.0:1789181408.256071:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181408.256114:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789181408.256121:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfa2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510053504:0@lo:400:kworker.0 00000100:00100000:1.0:1789181408.256145:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181408.256209:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510053760 00000100:00100000:1.0:1789181408.256214:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510053760 00000100:00100000:1.0:1789181408.256255:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510053504 00000100:00100000:1.0:1789181408.256258:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510053504 00000100:00100000:1.0:1789181408.256281:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789181408.256288:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b66f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876092510053760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181408.256363:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b66f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876092510053760:12345-0@lo:400:kworker.0 Request processed in 43us (1413us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181408.256371:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789181408.256385:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789181408.256391:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfcf5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510053504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181408.256423:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfcf5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510053504:12345-0@lo:400:kworker.0 Request processed in 33us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181408.256429:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789181408.256445:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510053120 00000100:00100000:1.0:1789181408.256448:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510053120 00000100:00100000:1.0:1789181408.256474:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1789181408.256479:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189954850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:3304:x1876092510053120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181408.256509:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189954850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:3304:x1876092510053120:12345-0@lo:400:kworker.0 Request processed in 30us (1518us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181408.256515:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00080000:1.0:1789181408.256551:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789181408.256556:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789181408.256579:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc1bfa2c700 x1876092510053504/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181424 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181408.256593:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfa2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510053504:0@lo:400:kworker.0 00000100:00100000:0.0:1789181408.257322:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510053376 00000100:00100000:0.0:1789181408.257356:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510053376 00000100:00100000:0.0:1789181408.257405:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789181408.257414:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfcf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876092510053376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181408.257465:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfcf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876092510053376:12345-0@lo:400:kworker.0 Request processed in 54us (1394us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181408.257471:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789181408.257503:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfa2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:880710ad-110c-42a4-a174-ab1b99a7ebeb:3304:1876092510053120:0@lo:400:kworker.0 00010000:00080000:0.0:1789181408.257517:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc1bfa2e680 x1876092510053760/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181424 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181408.257527:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfa2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876092510053760:0@lo:400:kworker.0 00000100:00100000:3.0:1789181408.258027:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfa2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1876092510053376:0@lo:400:kworker.0 00000100:00080000:1.0:1789181408.258352:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789181408.767374:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfa2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510053888:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789181408.767457:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181408.776755:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510053888 00000100:00100000:2.0:1789181408.776785:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510053888 00000100:00100000:2.0:1789181408.776900:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789181408.776910:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1baba5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510053888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789181408.776948:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00010000:00080000:1.0:1789181408.777180:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc1bfa2d180 x1876092510053888/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181424 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181408.777201:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfa2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510053888:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789181408.777260:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1baba5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510053888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 351us (9803us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181408.777267:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:1.0:1789181408.830694:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181409.855485:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181410.397600:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181410.397800:0:6887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488000128 00000100:00100000:0.0:1789181410.397811:0:6887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488000128 00000100:00100000:0.0:1789181410.397888:0:6887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 55 00000100:00100000:0.0:1789181410.397899:0:6887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b66ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+6:2353:x1876092488000128:12345-192.168.204.32@tcp:400:kworker.0 00000100:00080000:1.0:1789181410.397959:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789181410.397992:0:6887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b66ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+6:2353:x1876092488000128:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 94us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181410.398000:0:6887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 55 00000100:00100000:1.0:1789181410.415112:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181410.415770:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488000000 00000100:00100000:0.0:1789181410.415782:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488000000 00000100:00100000:0.0:1789181410.415844:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 203 00000100:00100000:0.0:1789181410.415856:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189956050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:975a0591-a8f7-4a74-9f93-a5aa77f2315c+10:2354:x1876092488000000:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:0.0:1789181410.415946:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189956050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:975a0591-a8f7-4a74-9f93-a5aa77f2315c+10:2354:x1876092488000000:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 91us (851us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181410.415968:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 203 00010000:00010000:1.0:1789181410.878604:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789181411.328512:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfb2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876092510054016:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789181411.328592:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181411.328678:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510054016 00000100:00100000:3.0:1789181411.328689:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510054016 00000100:00100000:3.0:1789181411.328757:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789181411.328768:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876092510054016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789181411.328808:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789181411.328864:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876092510054016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181411.328872:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1789181411.328898:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789181411.328945:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc1bfb2e680 x1876092510054016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181427 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181411.328966:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfb2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876092510054016:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789181411.906592:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181412.926751:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181413.375139:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfa2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1876092510054400:0@lo:400:kworker.0 00000100:00100000:1.0:1789181413.375213:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181413.375366:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789181413.375374:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfa2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510054528:0@lo:400:kworker.0 00000100:00100000:1.0:1789181413.375402:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181413.375441:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510054528 00000100:00100000:1.0:1789181413.375449:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510054528 00000100:00100000:1.0:1789181413.375506:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789181413.375516:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b66dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510054528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181413.375568:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b66dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510054528:12345-0@lo:400:kworker.0 Request processed in 54us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181413.375576:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1789181413.375617:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc1bfa2d880 x1876092510054528/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181429 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181413.375654:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfa2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510054528:0@lo:400:kworker.0 00000100:00100000:3.0:1789181413.376046:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfa2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:880710ad-110c-42a4-a174-ab1b99a7ebeb:3303:1876092510054144:0@lo:400:kworker.0 00000100:00100000:3.0:1789181413.376088:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181413.376123:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfa2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1876092510054656:0@lo:400:kworker.0 00000100:00100000:3.0:1789181413.376147:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181413.376167:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789181413.376173:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfa2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876092510054272:0@lo:400:kworker.0 00000100:00100000:3.0:1789181413.376191:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181413.376232:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfa2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876092510054784:0@lo:400:kworker.0 00000100:00100000:3.0:1789181413.376255:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789181413.376282:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789181413.376295:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510054400 00000100:00100000:3.0:1789181413.376299:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510054400 00000100:00100000:3.0:1789181413.376368:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510054656 00000100:00100000:3.0:1789181413.376372:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510054656 00000100:00100000:3.0:1789181413.376388:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510054272 00000100:00100000:3.0:1789181413.376391:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510054272 00000100:00100000:3.0:1789181413.376405:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789181413.376412:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b66dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876092510054400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181413.376451:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b66dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876092510054400:12345-0@lo:400:kworker.0 Request processed in 40us (1238us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181413.376458:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789181413.376472:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789181413.376478:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876092510054656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181413.376519:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876092510054656:12345-0@lo:400:kworker.0 Request processed in 41us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181413.376525:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789181413.376534:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789181413.376539:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876092510054272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181413.376558:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876092510054272:12345-0@lo:400:kworker.0 Request processed in 20us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181413.376563:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789181413.376582:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510054784 00000100:00100000:3.0:1789181413.376585:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510054784 00000100:00100000:3.0:1789181413.376611:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789181413.376617:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1876092510054784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181413.376646:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1876092510054784:12345-0@lo:400:kworker.0 Request processed in 29us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181413.376651:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:3.0:1789181413.376668:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789181413.376672:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789181413.377007:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510054144 00000100:00100000:1.0:1789181413.377012:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510054144 00000100:00100000:1.0:1789181413.377049:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1789181413.377056:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189956850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:3303:x1876092510054144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181413.377087:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189956850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:3303:x1876092510054144:12345-0@lo:400:kworker.0 Request processed in 33us (999us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181413.377093:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1789181413.377457:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfa2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876092510054272:0@lo:400:kworker.0 00010000:00080000:3.0:1789181413.377475:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc1bfa2ce00 x1876092510054784/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181429 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181413.377485:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfa2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876092510054784:0@lo:400:kworker.0 00000100:00100000:3.0:1789181413.377494:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfa2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:880710ad-110c-42a4-a174-ab1b99a7ebeb:3303:1876092510054144:0@lo:400:kworker.0 00000100:00100000:3.0:1789181413.377503:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfa2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1876092510054656:0@lo:400:kworker.0 00000100:00100000:3.0:1789181413.377540:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfa2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1876092510054400:0@lo:400:kworker.0 00000100:00100000:3.0:1789181413.892249:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfa2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510054912:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789181413.892321:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181413.892877:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510054912 00000100:00100000:1.0:1789181413.892886:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510054912 00000100:00100000:1.0:1789181413.892943:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789181413.892953:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510054912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789181413.892991:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789181413.910641:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510054912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 17676us (18306us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181413.910658:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:3.0:1789181413.910757:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc1bfa2dc00 x1876092510054912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181429 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181413.910783:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfa2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510054912:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789181413.950592:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181414.974921:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181415.512255:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181415.512315:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181415.512600:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488000384 00000100:00100000:3.0:1789181415.512611:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488000384 00000100:00100000:3.0:1789181415.512696:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 59 00000100:00100000:3.0:1789181415.512707:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b66f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+6:2353:x1876092488000384:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:3.0:1789181415.512780:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b66f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+6:2353:x1876092488000384:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 76us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181415.512787:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 59 00000100:00100000:1.0:1789181415.512877:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488000256 00000100:00100000:1.0:1789181415.512882:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488000256 00000100:00100000:1.0:1789181415.512911:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 205 00000100:00100000:1.0:1789181415.512918:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189977850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:975a0591-a8f7-4a74-9f93-a5aa77f2315c+10:2354:x1876092488000256:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:1.0:1789181415.512945:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189977850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:975a0591-a8f7-4a74-9f93-a5aa77f2315c+10:2354:x1876092488000256:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 28us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181415.512951:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 205 00000100:00080000:0.0:1789181415.513262:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789181415.999617:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181416.446638:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789181416.446662:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfb2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510055040:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789181416.446735:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181416.446846:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510055040 00000100:00100000:3.0:1789181416.446856:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510055040 00000100:00100000:3.0:1789181416.446924:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789181416.446935:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b66ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510055040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789181416.446967:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789181416.447016:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b66ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510055040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181416.447024:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:3.0:1789181416.447063:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc1bfb2e300 x1876092510055040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181432 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181416.447081:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfb2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510055040:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789181416.447141:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789181417.023634:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181418.046514:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181418.495811:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfa2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:880710ad-110c-42a4-a174-ab1b99a7ebeb:3303:1876092510055168:0@lo:400:kworker.0 00000100:00100000:0.0:1789181418.495889:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181418.496061:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510055168 00000100:00100000:1.0:1789181418.496070:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510055168 00000100:00100000:1.0:1789181418.496121:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1789181418.496131:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189977050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:3303:x1876092510055168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181418.504128:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189977050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:3303:x1876092510055168:12345-0@lo:400:kworker.0 Request processed in 7988us (8228us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181418.504154:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1789181418.507213:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfa2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876092510055296:0@lo:400:kworker.0 00000100:00100000:1.0:1789181418.507286:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181418.507448:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510055296 00000100:00100000:1.0:1789181418.507457:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510055296 00000100:00100000:1.0:1789181418.507509:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789181418.507519:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b66dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876092510055296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181418.507699:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b66dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876092510055296:12345-0@lo:400:kworker.0 Request processed in 181us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181418.507707:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789181418.507750:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfa2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876092510055296:0@lo:400:kworker.0 00000100:00100000:2.0:1789181418.507885:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789181418.507897:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfa2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1876092510055424:0@lo:400:kworker.0 00000100:00100000:2.0:1789181418.507929:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181418.508127:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510055424 00000100:00100000:2.0:1789181418.508132:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510055424 00000100:00100000:2.0:1789181418.508470:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789181418.508480:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfa2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876092510055424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181418.508523:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfa2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876092510055424:12345-0@lo:400:kworker.0 Request processed in 46us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181418.508541:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:2.0:1789181418.508695:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789181418.508727:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfa2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1876092510055424:0@lo:400:kworker.0 00000100:00100000:2.0:1789181418.508765:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfa2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876092510055552:0@lo:400:kworker.0 00000100:00100000:2.0:1789181418.508794:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181418.508824:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510055552 00000100:00100000:2.0:1789181418.508828:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510055552 00000100:00100000:2.0:1789181418.508859:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789181418.508865:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfa2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876092510055552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181418.508898:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfa2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876092510055552:12345-0@lo:400:kworker.0 Request processed in 33us (104us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181418.508904:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:2.0:1789181418.508917:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789181418.510110:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc1bfa2ed80 x1876092510055552/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181434 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181418.510131:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfa2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876092510055552:0@lo:400:kworker.0 00000100:00100000:2.0:1789181418.510768:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789181418.510780:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfa2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1876092510055680:0@lo:400:kworker.0 00000100:00100000:2.0:1789181418.510833:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181418.510877:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510055680 00000100:00100000:2.0:1789181418.510883:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510055680 00000100:00100000:2.0:1789181418.510929:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789181418.511733:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfa2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:880710ad-110c-42a4-a174-ab1b99a7ebeb:3303:1876092510055168:0@lo:400:kworker.0 00000100:00100000:2.0:1789181418.512818:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfa2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876092510055680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181418.512915:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfa2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876092510055680:12345-0@lo:400:kworker.0 Request processed in 1979us (2082us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181418.513732:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfa2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1876092510055680:0@lo:400:kworker.0 00000100:00100000:2.0:1789181418.514018:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:2.0:1789181418.514113:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789181418.514445:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789181418.514458:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfa2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876092510055808:0@lo:400:kworker.0 00000100:00100000:2.0:1789181418.514503:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181418.514533:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510055808 00000100:00100000:2.0:1789181418.514540:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510055808 00000100:00100000:2.0:1789181418.514604:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789181418.514613:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfa2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1876092510055808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181418.515746:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfa2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1876092510055808:12345-0@lo:400:kworker.0 Request processed in 1130us (1237us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181418.515757:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:2.0:1789181418.515785:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789181418.515818:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc1bfa2dc00 x1876092510055808/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181434 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181418.515832:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfa2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876092510055808:0@lo:400:kworker.0 00000100:00100000:1.0:1789181419.006893:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfa2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510055936:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789181419.006969:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181419.007082:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510055936 00000100:00100000:3.0:1789181419.007105:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510055936 00000100:00100000:3.0:1789181419.007178:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789181419.007187:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b66dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510055936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789181419.007228:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789181419.008975:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b66dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510055936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1781us (1997us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181419.008989:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1789181419.009228:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc1bfa2dc00 x1876092510055936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181435 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181419.009252:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfa2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510055936:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789181419.082720:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181420.100127:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789181420.646589:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181420.646647:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181420.646753:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488000640 00000100:00100000:2.0:1789181420.646764:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488000640 00000100:00100000:2.0:1789181420.646859:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 63 00000100:00100000:2.0:1789181420.646871:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+6:2353:x1876092488000640:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:2.0:1789181420.646942:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+6:2353:x1876092488000640:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 74us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181420.646950:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 63 00000100:00080000:3.0:1789181420.647013:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789181420.650491:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488000512 00000100:00100000:1.0:1789181420.650507:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488000512 00000100:00100000:1.0:1789181420.650586:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 207 00000100:00100000:1.0:1789181420.650598:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189974850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:975a0591-a8f7-4a74-9f93-a5aa77f2315c+10:2353:x1876092488000512:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:1.0:1789181420.650681:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189974850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:975a0591-a8f7-4a74-9f93-a5aa77f2315c+10:2353:x1876092488000512:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 85us (4033us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181420.650689:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 207 00010000:00010000:1.0:1789181421.120737:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181421.567045:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789181421.568833:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfb2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510056064:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789181421.568907:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181421.569232:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510056064 00000100:00100000:0.0:1789181421.569240:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510056064 00000100:00080000:3.0:1789181421.569614:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789181421.569741:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789181421.569754:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b66dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510056064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789181421.569795:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789181421.569854:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b66dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510056064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (946us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181421.569860:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1789181421.570848:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc1bfb2ce00 x1876092510056064/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181437 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181421.570870:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfb2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510056064:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1789181421.684913:0:10126:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 22:50:21 (1789181421) === 00010000:00010000:1.0:1789181422.142589:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789181422.220977:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181422.221088:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488000768 00000100:00100000:1.0:1789181422.221099:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488000768 00000100:00100000:1.0:1789181422.221157:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 208 00000100:00100000:1.0:1789181422.221167:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189976050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:975a0591-a8f7-4a74-9f93-a5aa77f2315c+10:8127:x1876092488000768:12345-192.168.204.32@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789181422.221184:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181422.221204:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc1c2044000/0x8f4f7840b2e411ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91ef76 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181422.221233:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc1c2044000/0x8f4f7840b2e411ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91ef76 expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181422.221245:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc1c2044000/0x8f4f7840b2e411ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91ef76 expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181422.221272:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1c2044000, rc 0) 00000100:00100000:1.0:1789181422.221365:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189976050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:975a0591-a8f7-4a74-9f93-a5aa77f2315c+11:8127:x1876092488000768:12345-192.168.204.32@tcp:101:mount.lustre.0 Request processed in 199us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181422.221372:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 208 00000100:00100000:3.0:1789181422.226431:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181422.226538:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488000896 00000100:00100000:2.0:1789181422.226548:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488000896 00000100:00100000:2.0:1789181422.226609:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 209 00000100:00100000:2.0:1789181422.226633:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189976850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:975a0591-a8f7-4a74-9f93-a5aa77f2315c+11:8127:x1876092488000896:12345-192.168.204.32@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789181422.226930:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189976850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:975a0591-a8f7-4a74-9f93-a5aa77f2315c+11:8127:x1876092488000896:12345-192.168.204.32@tcp:501:mount.lustre.0 Request processed in 287us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181422.226938:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 209 00000100:00100000:0.0:1789181422.235407:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181422.235490:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488001024 00000100:00100000:3.0:1789181422.235500:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488001024 00000100:00100000:3.0:1789181422.235575:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 210 00000100:00100000:3.0:1789181422.235585:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189974050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:975a0591-a8f7-4a74-9f93-a5aa77f2315c+11:8127:x1876092488001024:12345-192.168.204.32@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789181422.235821:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189974050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:975a0591-a8f7-4a74-9f93-a5aa77f2315c+11:8127:x1876092488001024:12345-192.168.204.32@tcp:503:mount.lustre.0 Request processed in 236us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181422.235829:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 210 00000100:00100000:3.0:1789181422.241593:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181422.241879:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488001152 00000100:00100000:1.0:1789181422.241890:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488001152 00000100:00100000:1.0:1789181422.241939:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 211 00000100:00100000:1.0:1789181422.241950:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189975c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:975a0591-a8f7-4a74-9f93-a5aa77f2315c+11:8131:x1876092488001152:12345-192.168.204.32@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789181422.242355:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189975c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:975a0591-a8f7-4a74-9f93-a5aa77f2315c+11:8131:x1876092488001152:12345-192.168.204.32@tcp:502:llog_process_th.0 Request processed in 379us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181422.242364:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 211 00000100:00100000:1.0:1789181422.256322:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181422.258429:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488001280 00000100:00100000:2.0:1789181422.258444:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488001280 00000100:00100000:2.0:1789181422.258526:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 212 00000100:00100000:2.0:1789181422.258537:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189974450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:975a0591-a8f7-4a74-9f93-a5aa77f2315c+11:8131:x1876092488001280:12345-192.168.204.32@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789181422.258823:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189974450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:975a0591-a8f7-4a74-9f93-a5aa77f2315c+11:8131:x1876092488001280:12345-192.168.204.32@tcp:502:llog_process_th.0 Request processed in 287us (2509us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181422.258832:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 212 00000100:00100000:0.0:1789181422.269253:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181422.269376:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488001408 00000100:00100000:3.0:1789181422.269387:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488001408 00000100:00100000:3.0:1789181422.269447:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 213 00000100:00100000:3.0:1789181422.269458:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189976c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:975a0591-a8f7-4a74-9f93-a5aa77f2315c+11:8127:x1876092488001408:12345-192.168.204.32@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789181422.269474:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181422.269492:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc1bfa1e200/0x8f4f7840b2e411f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91efa0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181422.269540:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc1bfa1e200/0x8f4f7840b2e411f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91efa0 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181422.269552:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc1bfa1e200/0x8f4f7840b2e411f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91efa0 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181422.269562:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1bfa1e200, rc 0) 00000100:00100000:3.0:1789181422.269632:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189976c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:975a0591-a8f7-4a74-9f93-a5aa77f2315c+12:8127:x1876092488001408:12345-192.168.204.32@tcp:101:mount.lustre.0 Request processed in 175us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181422.269639:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 213 00000100:00100000:3.0:1789181422.281088:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181422.281307:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488001536 00000100:00100000:2.0:1789181422.281319:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488001536 00000100:00100000:2.0:1789181422.281406:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 214 00000100:00100000:2.0:1789181422.281419:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189974c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:975a0591-a8f7-4a74-9f93-a5aa77f2315c+12:8127:x1876092488001536:12345-192.168.204.32@tcp:256:mount.lustre.0 20000000:01000000:2.0:1789181422.281445:0:5837:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789181422.281469:0:5837:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789181422.281474:0:5837:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789181422.281477:0:5837:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789181422.281479:0:5837:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1789181422.283632:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189974c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:975a0591-a8f7-4a74-9f93-a5aa77f2315c+12:8127:x1876092488001536:12345-192.168.204.32@tcp:256:mount.lustre.0 Request processed in 2207us (2554us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181422.283646:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 214 00000100:00100000:0.0:1789181422.289043:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181422.289154:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488001664 00000100:00100000:1.0:1789181422.289165:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488001664 00000100:00100000:1.0:1789181422.289259:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 215 00000100:00100000:1.0:1789181422.289270:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189975450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:975a0591-a8f7-4a74-9f93-a5aa77f2315c+12:8127:x1876092488001664:12345-192.168.204.32@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789181422.289287:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181422.289305:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc1c2045400/0x8f4f7840b2e411fc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91efa7 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181422.289359:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc1c2045400/0x8f4f7840b2e411fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91efa7 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181422.289390:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc1c2045400/0x8f4f7840b2e411fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91efa7 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181422.289400:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1c2045400, rc 0) 00000100:00100000:1.0:1789181422.289460:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189975450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:975a0591-a8f7-4a74-9f93-a5aa77f2315c+13:8127:x1876092488001664:12345-192.168.204.32@tcp:101:mount.lustre.0 Request processed in 192us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181422.289467:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 215 00000100:00100000:0.0:1789181422.295955:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181422.296220:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488001792 00000100:00100000:2.0:1789181422.296231:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488001792 00000100:00100000:2.0:1789181422.296286:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 216 00000100:00100000:2.0:1789181422.296296:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189975050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:975a0591-a8f7-4a74-9f93-a5aa77f2315c+13:8127:x1876092488001792:12345-192.168.204.32@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789181422.296720:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189975050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:975a0591-a8f7-4a74-9f93-a5aa77f2315c+13:8127:x1876092488001792:12345-192.168.204.32@tcp:501:mount.lustre.0 Request processed in 423us (774us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181422.296738:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 216 00000100:00100000:2.0:1789181422.305759:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181422.305879:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488001920 00000100:00100000:3.0:1789181422.305889:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488001920 00000100:00100000:3.0:1789181422.305943:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 217 00000100:00100000:3.0:1789181422.305954:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189975850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:975a0591-a8f7-4a74-9f93-a5aa77f2315c+13:8127:x1876092488001920:12345-192.168.204.32@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789181422.307047:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189975850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:975a0591-a8f7-4a74-9f93-a5aa77f2315c+13:8127:x1876092488001920:12345-192.168.204.32@tcp:503:mount.lustre.0 Request processed in 1092us (1300us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181422.307056:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 217 00000100:00100000:0.0:1789181422.314612:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181422.314761:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488002048 00000100:00100000:1.0:1789181422.314772:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488002048 00000100:00100000:1.0:1789181422.314833:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 218 00000100:00100000:1.0:1789181422.314844:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189976450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:975a0591-a8f7-4a74-9f93-a5aa77f2315c+13:8133:x1876092488002048:12345-192.168.204.32@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789181422.315137:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189976450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:975a0591-a8f7-4a74-9f93-a5aa77f2315c+13:8133:x1876092488002048:12345-192.168.204.32@tcp:502:llog_process_th.0 Request processed in 293us (1223us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181422.315146:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 218 00000100:00100000:0.0:1789181422.322584:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181422.324287:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488002176 00000100:00100000:2.0:1789181422.324301:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488002176 00000100:00100000:2.0:1789181422.324381:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 219 00000100:00100000:2.0:1789181422.324392:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189977450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:975a0591-a8f7-4a74-9f93-a5aa77f2315c+13:8133:x1876092488002176:12345-192.168.204.32@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789181422.324659:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189977450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:975a0591-a8f7-4a74-9f93-a5aa77f2315c+13:8133:x1876092488002176:12345-192.168.204.32@tcp:502:llog_process_th.0 Request processed in 268us (2084us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181422.324667:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 219 00000100:00100000:2.0:1789181422.336433:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181422.336576:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488002688 00000100:00100000:1.0:1789181422.336586:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488002688 00000100:00100000:1.0:1789181422.336661:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 64 00000100:00100000:1.0:1789181422.336673:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfa2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+6:2352:x1876092488002688:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:1.0:1789181422.336748:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfa2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+6:2352:x1876092488002688:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 79us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181422.336756:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 64 00000100:00100000:2.0:1789181422.336957:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00080000:3.0:1789181422.339799:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789181422.345138:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488002304 00000100:00100000:1.0:1789181422.345155:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488002304 00000100:00100000:1.0:1789181422.345224:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 10 00000100:00100000:1.0:1789181422.345233:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfa2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2350:x1876092488002304:12345-192.168.204.32@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789181422.345278:0:5844:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 7badad21-a177-49b1-a2af-7b11e28c02ce@192.168.204.32@tcp t0 exp 0000000000000000 cur 314 last 0 00000020:00000080:1.0:1789181422.345325:0:5844:0:(genops.c:1384:class_connect()) connect: client 7badad21-a177-49b1-a2af-7b11e28c02ce, cookie 0x8f4f7840b2e41203 00000004:00100000:1.0:1789181422.345371:0:5844:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1789181422.346236:0:5844:0:(import.c:65:import_set_state_nolock()) ffff9dc1b6719000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789181422.346322:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfa2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7badad21-a177-49b1-a2af-7b11e28c02ce+6:2350:x1876092488002304:12345-192.168.204.32@tcp:38:mount.lustre.0 Request processed in 1087us (9834us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181422.346360:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 10 00000100:00100000:1.0:1789181422.356099:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181422.358039:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488002560 00000100:00100000:2.0:1789181422.358054:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488002560 00000100:00100000:2.0:1789181422.358156:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 11 00000100:00100000:2.0:1789181422.358168:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b66dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7badad21-a177-49b1-a2af-7b11e28c02ce+6:8127:x1876092488002560:12345-192.168.204.32@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789181422.358226:0:5843:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789181422.358366:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b66dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7badad21-a177-49b1-a2af-7b11e28c02ce+6:8127:x1876092488002560:12345-192.168.204.32@tcp:41:mount.lustre.0 Request processed in 199us (2275us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181422.358373:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 11 00000100:00080000:3.0:1789181422.358456:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789181422.362041:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181422.362131:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181422.381736:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488002432 00000100:00100000:1.0:1789181422.381751:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488002432 00000100:00100000:1.0:1789181422.381817:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488002816 00000100:00100000:1.0:1789181422.381821:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488002816 00000100:00100000:1.0:1789181422.381859:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 12 00000100:00100000:1.0:1789181422.381878:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfa2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7badad21-a177-49b1-a2af-7b11e28c02ce+7:0:x1876092488002432:12345-192.168.204.32@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789181422.381912:0:5844:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789181422.381989:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfa2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7badad21-a177-49b1-a2af-7b11e28c02ce+7:0:x1876092488002432:12345-192.168.204.32@tcp:41:mount.lustre.0 Request processed in 113us (19958us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181422.381997:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 12 00000100:00100000:1.0:1789181422.382015:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 13 00000100:00100000:1.0:1789181422.382022:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfa2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7badad21-a177-49b1-a2af-7b11e28c02ce+6:8127:x1876092488002816:12345-192.168.204.32@tcp:40:mount.lustre.0 00000100:00100000:1.0:1789181422.382053:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfa2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7badad21-a177-49b1-a2af-7b11e28c02ce+6:8127:x1876092488002816:12345-192.168.204.32@tcp:40:mount.lustre.0 Request processed in 31us (19922us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181422.382059:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 13 00000100:00100000:1.0:1789181422.389145:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181422.389198:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181422.389242:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181422.389367:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488003200 00000100:00100000:2.0:1789181422.389376:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488003200 00000100:00100000:2.0:1789181422.389431:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1 00000100:00100000:2.0:1789181422.389441:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b66de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7badad21-a177-49b1-a2af-7b11e28c02ce+6:8127:x1876092488003200:12345-192.168.204.32@tcp:33:mount.lustre.0 00000004:00200000:2.0:1789181422.389552:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1789181422.389632:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b66de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7badad21-a177-49b1-a2af-7b11e28c02ce+6:8127:x1876092488003200:12345-192.168.204.32@tcp:33:mount.lustre.0 Request processed in 192us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181422.389641:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1 00000100:00100000:2.0:1789181422.389666:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488002944 00000100:00100000:2.0:1789181422.389670:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488002944 00000100:00100000:2.0:1789181422.389687:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488003072 00000100:00100000:2.0:1789181422.389690:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488003072 00000100:00100000:2.0:1789181422.389704:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 12 00000100:00100000:2.0:1789181422.389709:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b66df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2350:x1876092488002944:12345-192.168.204.32@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789181422.389732:0:6692:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 7badad21-a177-49b1-a2af-7b11e28c02ce@192.168.204.32@tcp t0 exp 0000000000000000 cur 314 last 0 00000020:00000080:2.0:1789181422.389763:0:6692:0:(genops.c:1384:class_connect()) connect: client 7badad21-a177-49b1-a2af-7b11e28c02ce, cookie 0x8f4f7840b2e4120a 00002000:00100000:2.0:1789181422.389775:0:6692:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7badad21-a177-49b1-a2af-7b11e28c02ce/ffff9dc1b670b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789181422.389787:0:6692:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789181422.390028:0:6692:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789181422.390054:0:6692:0:(import.c:65:import_set_state_nolock()) ffff9dc1b670b800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789181422.390082:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b66df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7badad21-a177-49b1-a2af-7b11e28c02ce+6:2350:x1876092488002944:12345-192.168.204.32@tcp:8:mount.lustre.0 Request processed in 371us (883us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181422.390088:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 12 00000100:00100000:2.0:1789181422.390101:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 13 00000100:00100000:2.0:1789181422.390106:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b66dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2350:x1876092488003072:12345-192.168.204.32@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789181422.390120:0:6692:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 7badad21-a177-49b1-a2af-7b11e28c02ce@192.168.204.32@tcp t0 exp 0000000000000000 cur 314 last 0 00000020:00000080:2.0:1789181422.390135:0:6692:0:(genops.c:1384:class_connect()) connect: client 7badad21-a177-49b1-a2af-7b11e28c02ce, cookie 0x8f4f7840b2e41211 00002000:00100000:2.0:1789181422.390140:0:6692:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7badad21-a177-49b1-a2af-7b11e28c02ce/ffff9dc1b670c800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789181422.390160:0:6692:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789181422.390282:0:6692:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789181422.390297:0:6692:0:(import.c:65:import_set_state_nolock()) ffff9dc1b670f000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789181422.390318:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b66dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7badad21-a177-49b1-a2af-7b11e28c02ce+6:2350:x1876092488003072:12345-192.168.204.32@tcp:8:mount.lustre.0 Request processed in 210us (1075us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181422.390324:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 13 00010000:00010000:1.0:1789181423.167004:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181423.614558:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfa2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:880710ad-110c-42a4-a174-ab1b99a7ebeb:3303:1876092510056192:0@lo:400:kworker.0 00000100:00100000:2.0:1789181423.614630:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181423.614675:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfa2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1876092510056704:0@lo:400:kworker.0 00000100:00100000:2.0:1789181423.614698:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181423.614719:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789181423.614724:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfa2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876092510056320:0@lo:400:kworker.0 00000100:00100000:2.0:1789181423.614744:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181423.614758:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc18854bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876092510056832:0@lo:400:kworker.0 00000100:00100000:2.0:1789181423.614778:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181423.614802:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfa2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876092510056576:0@lo:400:kworker.0 00000100:00100000:2.0:1789181423.614823:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181423.614839:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789181423.614844:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfa2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1876092510056448:0@lo:400:kworker.0 00000100:00100000:2.0:1789181423.614884:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181423.614914:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510056192 00000100:00100000:2.0:1789181423.614921:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510056192 00000100:00100000:2.0:1789181423.614959:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1789181423.614967:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189977c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:3303:x1876092510056192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181423.615011:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189977c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:3303:x1876092510056192:12345-0@lo:400:kworker.0 Request processed in 45us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181423.615025:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1789181423.615056:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510056832 00000100:00100000:2.0:1789181423.615059:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510056832 00000100:00100000:2.0:1789181423.615085:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510056576 00000100:00100000:2.0:1789181423.615087:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510056576 00000100:00100000:2.0:1789181423.615103:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789181423.615109:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc188549880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1876092510056832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181423.615135:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc188549880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1876092510056832:12345-0@lo:400:kworker.0 Request processed in 27us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181423.615140:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789181423.615150:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789181423.615154:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc188548700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876092510056576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181423.615177:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc188548700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876092510056576:12345-0@lo:400:kworker.0 Request processed in 23us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181423.615182:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789181423.615200:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510056704 00000100:00100000:2.0:1789181423.615203:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510056704 00000100:00100000:2.0:1789181423.615224:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510056320 00000100:00100000:2.0:1789181423.615226:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510056320 00000100:00100000:2.0:1789181423.615235:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510056448 00000100:00100000:2.0:1789181423.615237:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510056448 00000100:00100000:2.0:1789181423.615249:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789181423.615254:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc188549c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876092510056704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181423.615282:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc188549c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876092510056704:12345-0@lo:400:kworker.0 Request processed in 28us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181423.615287:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789181423.615297:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789181423.615309:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc18854b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876092510056320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181423.615367:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc18854b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876092510056320:12345-0@lo:400:kworker.0 Request processed in 59us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181423.615373:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789181423.615384:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789181423.615390:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876092510056448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181423.615416:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876092510056448:12345-0@lo:400:kworker.0 Request processed in 27us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181423.615421:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789181423.615463:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfa2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1876092510056448:0@lo:400:kworker.0 00010000:00080000:2.0:1789181423.615474:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc1bfa2ed80 x1876092510056576/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181439 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181423.615483:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfa2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876092510056576:0@lo:400:kworker.0 00000100:00100000:2.0:1789181423.615526:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfa2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876092510056320:0@lo:400:kworker.0 00010000:00080000:2.0:1789181423.615535:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc18854bb80 x1876092510056832/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181439 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181423.615544:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc18854bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876092510056832:0@lo:400:kworker.0 00000100:00100000:2.0:1789181423.615552:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfa2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:880710ad-110c-42a4-a174-ab1b99a7ebeb:3303:1876092510056192:0@lo:400:kworker.0 00000100:00100000:2.0:1789181423.615559:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfa2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1876092510056704:0@lo:400:kworker.0 00000100:00080000:3.0:1789181423.615651:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789181423.615656:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789181423.615658:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789181424.129261:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfb44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510056960:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789181424.129347:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181424.129423:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510056960 00000100:00100000:2.0:1789181424.129440:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510056960 00000100:00100000:2.0:1789181424.129497:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789181424.129507:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510056960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789181424.129544:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789181424.129589:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510056960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181424.129596:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:2.0:1789181424.129635:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc1bfb44000 x1876092510056960/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181440 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181424.129654:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfb44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510056960:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789181424.191594:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789181424.684302:0:5865:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7badad21-a177-49b1-a2af-7b11e28c02ce 00010000:00010000:1.0:1789181425.217046:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789181425.270119:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7badad21-a177-49b1-a2af-7b11e28c02ce 00000001:00100000:3.0:1789181425.718364:0:6718:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7badad21-a177-49b1-a2af-7b11e28c02ce 00010000:00010000:2.0:1789181426.238782:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181426.687604:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfb2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876092510057088:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789181426.687675:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181426.688198:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510057088 00000100:00100000:1.0:1789181426.688223:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510057088 00000100:00100000:1.0:1789181426.688290:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789181426.688301:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876092510057088:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789181426.688685:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1789181426.688756:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789181426.688824:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876092510057088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 526us (1149us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181426.688831:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:2.0:1789181426.689108:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc1bfb2f800 x1876092510057088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181442 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181426.689128:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfb2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876092510057088:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789181427.263474:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181427.802233:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181427.802276:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181427.802307:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181427.802582:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488003328 00000100:00100000:1.0:1789181427.802592:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488003328 00000100:00100000:0.0:1789181427.802670:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488003456 00000100:00100000:0.0:1789181427.802675:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488003456 00000100:00100000:3.0:1789181427.803464:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488003712 00000100:00100000:3.0:1789181427.803484:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488003712 00000100:00100000:1.0:1789181427.808405:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 221 00000100:00100000:1.0:1789181427.808441:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:975a0591-a8f7-4a74-9f93-a5aa77f2315c+13:2353:x1876092488003328:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:0.0:1789181427.808829:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 68 00000100:00100000:0.0:1789181427.808846:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+6:2353:x1876092488003456:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:1.0:1789181427.811884:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:975a0591-a8f7-4a74-9f93-a5aa77f2315c+13:2353:x1876092488003328:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 3442us (9562us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181427.811899:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 221 00000100:00080000:1.0:1789181427.816019:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789181427.816030:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789181427.822743:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181427.822760:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+6:2353:x1876092488003456:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 13916us (20532us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181427.822774:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 68 00000100:00100000:0.0:1789181427.822813:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488003584 00000100:00100000:0.0:1789181427.822823:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488003584 00000100:00100000:2.0:1789181427.822845:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 39 00000100:00100000:2.0:1789181427.822861:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7badad21-a177-49b1-a2af-7b11e28c02ce+5:2353:x1876092488003712:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:1.0:1789181427.822882:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181427.822889:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 69 00000100:00100000:0.0:1789181427.822901:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7badad21-a177-49b1-a2af-7b11e28c02ce+5:2353:x1876092488003584:12345-192.168.204.32@tcp:400:kworker.0 00000100:00080000:1.0:1789181427.822910:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789181427.822924:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7badad21-a177-49b1-a2af-7b11e28c02ce+5:2353:x1876092488003712:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 67us (20644us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181427.823020:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 39 00000100:00100000:2.0:1789181427.823034:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488003840 00000100:00100000:2.0:1789181427.823038:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488003840 00000100:00100000:2.0:1789181427.823071:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 40 00000100:00100000:2.0:1789181427.823078:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b66dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7badad21-a177-49b1-a2af-7b11e28c02ce+5:2353:x1876092488003840:12345-192.168.204.32@tcp:400:kworker.0 00000100:00080000:1.0:1789181427.823113:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789181427.823114:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b66dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7badad21-a177-49b1-a2af-7b11e28c02ce+5:2353:x1876092488003840:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 35us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181427.823123:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 40 00000100:00100000:0.0:1789181427.826913:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7badad21-a177-49b1-a2af-7b11e28c02ce+5:2353:x1876092488003584:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 41us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181427.826929:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 69 00010000:00010000:2.0:1789181428.292861:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181428.734775:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfb47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:880710ad-110c-42a4-a174-ab1b99a7ebeb:3303:1876092510057216:0@lo:400:kworker.0 00000100:00100000:2.0:1789181428.734850:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181428.734895:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfb47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1876092510057728:0@lo:400:kworker.0 00000100:00100000:2.0:1789181428.734921:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181428.734947:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789181428.734953:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfb44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876092510057344:0@lo:400:kworker.0 00000100:00100000:2.0:1789181428.734971:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181428.734985:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfb44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876092510057856:0@lo:400:kworker.0 00000100:00100000:2.0:1789181428.735004:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181428.735125:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfb46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1876092510057472:0@lo:400:kworker.0 00000100:00100000:1.0:1789181428.735175:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510057216 00000100:00100000:1.0:1789181428.735184:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510057216 00000100:00100000:1.0:1789181428.735237:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1789181428.735246:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:3303:x1876092510057216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181428.743856:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181428.743912:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789181428.743926:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfb45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510057600:0@lo:400:kworker.0 00000100:00100000:0.0:1789181428.743963:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181428.744136:0:6887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510057728 00000100:00100000:0.0:1789181428.744151:0:6887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510057728 00000100:00100000:0.0:1789181428.744208:0:6887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510057344 00000100:00100000:0.0:1789181428.744212:0:6887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510057344 00000100:00100000:0.0:1789181428.744226:0:6887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510057472 00000100:00100000:0.0:1789181428.744228:0:6887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510057472 00000100:00100000:0.0:1789181428.744242:0:6887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789181428.744250:0:6887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876092510057728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181428.744301:0:6887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876092510057728:12345-0@lo:400:kworker.0 Request processed in 51us (9378us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181428.744307:0:6887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789181428.744322:0:6887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789181428.744327:0:6887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876092510057344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181428.744371:0:6887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876092510057344:12345-0@lo:400:kworker.0 Request processed in 44us (9399us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181428.744377:0:6887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789181428.744400:0:6887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789181428.744407:0:6887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b66f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876092510057472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181428.744437:0:6887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b66f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876092510057472:12345-0@lo:400:kworker.0 Request processed in 32us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181428.744443:0:6887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789181428.744460:0:6894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510057856 00000100:00100000:0.0:1789181428.744464:0:6894:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510057856 00000100:00100000:0.0:1789181428.745585:0:6894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510057600 00000100:00100000:0.0:1789181428.745594:0:6894:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510057600 00000100:00100000:0.0:1789181428.745638:0:6894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789181428.745646:0:6894:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1876092510057856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181428.745698:0:6894:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1876092510057856:12345-0@lo:400:kworker.0 Request processed in 54us (10693us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181428.745722:0:6894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789181428.745736:0:6894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789181428.745742:0:6894:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c02ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510057600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181428.745773:0:6894:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c02ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510057600:12345-0@lo:400:kworker.0 Request processed in 31us (1809us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181428.745778:0:6894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:0.0:1789181428.745962:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc1bfb45c00 x1876092510057600/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181444 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181428.745978:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfb45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510057600:0@lo:400:kworker.0 00000100:00100000:0.0:1789181428.745990:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfb46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1876092510057472:0@lo:400:kworker.0 00000100:00080000:1.0:1789181428.746588:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789181428.746594:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789181428.746597:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789181428.746664:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:3303:x1876092510057216:12345-0@lo:400:kworker.0 Request processed in 11417us (11811us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181428.746672:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00010000:00080000:2.0:1789181428.748662:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc1bfb44380 x1876092510057856/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181444 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181428.748682:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfb44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876092510057856:0@lo:400:kworker.0 00000100:00100000:2.0:1789181428.748695:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfb47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:880710ad-110c-42a4-a174-ab1b99a7ebeb:3303:1876092510057216:0@lo:400:kworker.0 00000100:00100000:2.0:1789181428.748709:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfb47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1876092510057728:0@lo:400:kworker.0 00000100:00100000:2.0:1789181428.748760:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfb44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876092510057344:0@lo:400:kworker.0 00000001:02000400:3.0:1789181428.957639:0:10323:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg432-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:0.0:1789181429.246566:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfb44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510057984:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789181429.246641:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181429.246899:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510057984 00000100:00100000:2.0:1789181429.246908:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510057984 00000100:00100000:2.0:1789181429.246962:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789181429.246971:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b66f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510057984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789181429.247007:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789181429.247061:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b66f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510057984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181429.247068:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1789181429.247171:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc1bfb44a80 x1876092510057984/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181445 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181429.247190:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfb44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510057984:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789181429.310915:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181430.334752:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181431.359557:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789181431.815560:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfb2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876092510058112:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789181431.815632:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181431.816060:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510058112 00000100:00100000:2.0:1789181431.816068:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510058112 00000100:00100000:2.0:1789181431.816132:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789181431.816143:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876092510058112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789181431.816208:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789181431.816264:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876092510058112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181431.816272:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:2.0:1789181431.816294:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789181431.816357:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc1bfb2ca80 x1876092510058112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181447 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181431.816377:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfb2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876092510058112:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789181432.382963:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181432.919383:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181432.920051:0:6887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488004096 00000100:00100000:2.0:1789181432.920063:0:6887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488004096 00000100:00100000:2.0:1789181432.920151:0:6887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 73 00000100:00100000:2.0:1789181432.920176:0:6887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b66df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+6:2354:x1876092488004096:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:2.0:1789181432.920250:0:6887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b66df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+6:2354:x1876092488004096:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 79us (878us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181432.920257:0:6887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 73 00000100:00080000:1.0:1789181432.921582:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789181432.923495:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181432.923541:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181432.923578:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181432.923605:0:6894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488004480 00000100:00100000:0.0:1789181432.923616:0:6894:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488004480 00000100:00100000:0.0:1789181432.923682:0:6894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 43 00000100:00100000:0.0:1789181432.923694:0:6894:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b66f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7badad21-a177-49b1-a2af-7b11e28c02ce+5:2353:x1876092488004480:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:1.0:1789181432.923703:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488003968 00000100:00100000:1.0:1789181432.923707:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488003968 00000100:00100000:1.0:1789181432.923734:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 223 00000100:00100000:1.0:1789181432.923740:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:975a0591-a8f7-4a74-9f93-a5aa77f2315c+13:2353:x1876092488003968:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:1.0:1789181432.923770:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:975a0591-a8f7-4a74-9f93-a5aa77f2315c+13:2353:x1876092488003968:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 30us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181432.923778:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 223 00000100:00100000:3.0:1789181432.923796:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488004224 00000100:00100000:3.0:1789181432.923800:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488004224 00000100:00100000:3.0:1789181432.924002:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 74 00000100:00100000:3.0:1789181432.924012:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b66f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7badad21-a177-49b1-a2af-7b11e28c02ce+5:2353:x1876092488004224:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:0.0:1789181432.928149:0:6894:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b66f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7badad21-a177-49b1-a2af-7b11e28c02ce+5:2353:x1876092488004480:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 4445us (4555us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181432.928165:0:6894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 43 00000100:00080000:0.0:1789181432.928218:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789181432.928224:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789181432.943482:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b66f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7badad21-a177-49b1-a2af-7b11e28c02ce+5:2353:x1876092488004224:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 19457us (19925us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181432.943498:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 74 00000100:00100000:1.0:1789181432.950781:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181432.951269:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488004352 00000100:00100000:1.0:1789181432.951278:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488004352 00000100:00100000:1.0:1789181432.951367:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 44 00000100:00100000:1.0:1789181432.951378:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b66de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7badad21-a177-49b1-a2af-7b11e28c02ce+5:2354:x1876092488004352:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:1.0:1789181432.951440:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b66de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7badad21-a177-49b1-a2af-7b11e28c02ce+5:2354:x1876092488004352:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 65us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181432.951447:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 44 00000100:00080000:3.0:1789181432.951602:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789181433.406550:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789181433.855111:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789181433.857448:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789181433.857476:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfb47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876092510058368:0@lo:400:kworker.0 00000100:00100000:1.0:1789181433.857544:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181433.857769:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfb47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:880710ad-110c-42a4-a174-ab1b99a7ebeb:3304:1876092510058240:0@lo:400:kworker.0 00000100:00100000:3.0:1789181433.857812:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181433.857853:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789181433.857862:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfb45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1876092510058752:0@lo:400:kworker.0 00000100:00100000:3.0:1789181433.857889:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181433.857889:0:6887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510058368 00000100:00100000:2.0:1789181433.857898:0:6887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510058368 00000100:00100000:3.0:1789181433.857915:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfb46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876092510058880:0@lo:400:kworker.0 00000100:00100000:2.0:1789181433.857942:0:6887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510058752 00000100:00100000:2.0:1789181433.857947:0:6887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510058752 00000100:00100000:3.0:1789181433.857953:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181433.857988:0:6887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789181433.857997:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789181433.858000:0:6887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b66dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876092510058368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181433.858012:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876092510058752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181433.858068:0:6887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b66dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876092510058368:12345-0@lo:400:kworker.0 Request processed in 69us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181433.858074:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876092510058752:12345-0@lo:400:kworker.0 Request processed in 65us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181433.858080:0:6887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789181433.858095:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789181433.858108:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfb44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1876092510058496:0@lo:400:kworker.0 00000100:00100000:2.0:1789181433.858137:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181433.858143:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfb45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1876092510058752:0@lo:400:kworker.0 00000100:00100000:2.0:1789181433.858161:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789181433.858171:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfb44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510058624:0@lo:400:kworker.0 00000100:00100000:2.0:1789181433.858194:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181433.858221:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510058496 00000100:00100000:2.0:1789181433.858226:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510058496 00000100:00100000:2.0:1789181433.858249:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789181433.858255:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876092510058496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181433.858351:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510058240 00000100:00100000:1.0:1789181433.858355:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510058240 00000100:00100000:1.0:1789181433.858454:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1789181433.858462:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c273050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:3304:x1876092510058240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181433.858498:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c273050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:3304:x1876092510058240:12345-0@lo:400:kworker.0 Request processed in 37us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181433.858504:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1789181433.858632:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876092510058496:12345-0@lo:400:kworker.0 Request processed in 376us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181433.858638:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789181433.858653:0:6894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510058880 00000100:00080000:2.0:1789181433.858654:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789181433.858657:0:6894:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510058880 00000100:00100000:2.0:1789181433.858684:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfb47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876092510058368:0@lo:400:kworker.0 00000100:00100000:0.0:1789181433.858687:0:6894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510058624 00000100:00100000:0.0:1789181433.858690:0:6894:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510058624 00000100:00080000:2.0:1789181433.858699:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789181433.858701:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789181433.858706:0:6894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789181433.858713:0:6894:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1876092510058880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181433.858745:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789181433.858747:0:6894:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1876092510058880:12345-0@lo:400:kworker.0 Request processed in 36us (795us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181433.858752:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510058624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181433.858753:0:6894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789181433.858781:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510058624:12345-0@lo:400:kworker.0 Request processed in 29us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181433.858786:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789181433.858845:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfb44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1876092510058496:0@lo:400:kworker.0 00010000:00080000:3.0:1789181433.858862:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc1bfb44700 x1876092510058624/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181449 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181433.858872:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfb44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510058624:0@lo:400:kworker.0 00010000:00080000:3.0:1789181433.858892:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc1bfb46680 x1876092510058880/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181449 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181433.858900:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfb46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876092510058880:0@lo:400:kworker.0 00000100:00100000:3.0:1789181433.858914:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfb47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:880710ad-110c-42a4-a174-ab1b99a7ebeb:3304:1876092510058240:0@lo:400:kworker.0 00000100:00100000:0.0:1789181434.371356:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789181434.371382:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfb47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876092510059008:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789181434.371456:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181434.371589:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510059008 00000100:00100000:2.0:1789181434.371598:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510059008 00000100:00100000:2.0:1789181434.371646:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789181434.371655:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b66f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876092510059008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789181434.371689:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789181434.371739:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b66f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876092510059008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181434.371745:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:0.0:1789181434.372440:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc1bfb47800 x1876092510059008/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181450 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181434.372460:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfb47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876092510059008:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789181434.430613:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181435.454662:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181436.486390:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181436.926597:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789181436.926620:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfb2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510059136:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789181436.926692:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181436.927001:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510059136 00000100:00100000:3.0:1789181436.927009:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510059136 00000100:00100000:3.0:1789181436.927087:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789181436.927100:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510059136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789181436.927138:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789181436.927199:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510059136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181436.927206:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:3.0:1789181436.927252:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc1bfb2c380 x1876092510059136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181452 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181436.927272:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfb2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510059136:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789181436.927826:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789181437.505487:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181438.043867:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181438.043910:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181438.043938:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181438.043963:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181438.043988:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181438.044014:0:6894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488004992 00000100:00100000:0.0:1789181438.044035:0:6894:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488004992 00000100:00100000:1.0:1789181438.044082:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488004608 00000100:00100000:1.0:1789181438.044086:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488004608 00000100:00100000:1.0:1789181438.044130:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 225 00000100:00100000:1.0:1789181438.044141:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:975a0591-a8f7-4a74-9f93-a5aa77f2315c+13:2354:x1876092488004608:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:1.0:1789181438.044204:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:975a0591-a8f7-4a74-9f93-a5aa77f2315c+13:2354:x1876092488004608:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 65us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181438.044221:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 225 00000100:00100000:3.0:1789181438.044431:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488004736 00000100:00100000:3.0:1789181438.044436:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488004736 00000100:00100000:0.0:1789181438.054905:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488005120 00000100:00100000:0.0:1789181438.054919:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488005120 00000100:00100000:3.0:1789181438.060979:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488004864 00000100:00100000:3.0:1789181438.060996:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488004864 00000100:00100000:3.0:1789181438.061189:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 78 00000100:00100000:3.0:1789181438.061201:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b66f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7badad21-a177-49b1-a2af-7b11e28c02ce+5:2354:x1876092488004864:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:3.0:1789181438.061516:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b66f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7badad21-a177-49b1-a2af-7b11e28c02ce+5:2354:x1876092488004864:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 317us (17551us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181438.061524:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 78 00000100:00080000:2.0:1789181438.062794:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789181438.062802:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789181438.062806:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789181438.071901:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 47 00000100:00100000:0.0:1789181438.071918:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b66f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7badad21-a177-49b1-a2af-7b11e28c02ce+5:2353:x1876092488004992:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:0.0:1789181438.071992:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b66f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7badad21-a177-49b1-a2af-7b11e28c02ce+5:2353:x1876092488004992:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 79us (28052us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181438.071999:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 47 00000100:00100000:0.0:1789181438.072015:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 48 00000100:00100000:0.0:1789181438.072022:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1baba7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7badad21-a177-49b1-a2af-7b11e28c02ce+5:2354:x1876092488005120:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:0.0:1789181438.072042:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1baba7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7badad21-a177-49b1-a2af-7b11e28c02ce+5:2354:x1876092488005120:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 21us (28054us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181438.072047:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 48 00000100:00100000:3.0:1789181438.082795:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 79 00000100:00100000:3.0:1789181438.082813:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b66f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+6:2353:x1876092488004736:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:3.0:1789181438.082899:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b66f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+6:2353:x1876092488004736:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 92us (38988us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181438.082906:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 79 00010000:00010000:3.0:1789181438.528387:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181438.975750:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfb46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:880710ad-110c-42a4-a174-ab1b99a7ebeb:3303:1876092510059264:0@lo:400:kworker.0 00000100:00100000:2.0:1789181438.975825:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181438.975873:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfb46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1876092510059776:0@lo:400:kworker.0 00000100:00100000:2.0:1789181438.975899:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181438.975923:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789181438.975928:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfb45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876092510059392:0@lo:400:kworker.0 00000100:00100000:2.0:1789181438.975945:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181438.975972:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfb44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876092510059904:0@lo:400:kworker.0 00000100:00100000:2.0:1789181438.975994:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181438.976055:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfb47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876092510059648:0@lo:400:kworker.0 00000100:00100000:0.0:1789181438.976085:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181438.976114:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789181438.976120:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfb47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1876092510059520:0@lo:400:kworker.0 00000100:00100000:0.0:1789181438.976141:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181438.976172:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510059904 00000100:00100000:0.0:1789181438.976178:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510059904 00000100:00100000:0.0:1789181438.976251:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510059648 00000100:00100000:0.0:1789181438.976255:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510059648 00000100:00100000:0.0:1789181438.976277:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789181438.976285:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc188549180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1876092510059904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181438.976366:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc188549180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1876092510059904:12345-0@lo:400:kworker.0 Request processed in 81us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181438.976383:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789181438.976402:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789181438.976408:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1baba4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876092510059648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181438.976443:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1baba4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876092510059648:12345-0@lo:400:kworker.0 Request processed in 36us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181438.976448:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:0.0:1789181438.976464:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789181438.976468:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789181438.976498:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc1bfb47b80 x1876092510059648/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181454 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181438.976512:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfb47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876092510059648:0@lo:400:kworker.0 00010000:00080000:0.0:1789181438.976539:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc1bfb44700 x1876092510059904/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181454 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181438.976548:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfb44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876092510059904:0@lo:400:kworker.0 00000100:00100000:3.0:1789181438.976870:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510059776 00000100:00100000:3.0:1789181438.976875:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510059776 00000100:00100000:3.0:1789181438.976950:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510059392 00000100:00100000:3.0:1789181438.976954:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510059392 00000100:00080000:0.0:1789181438.976989:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789181438.977067:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510059264 00000100:00100000:1.0:1789181438.977072:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510059264 00000100:00100000:1.0:1789181438.977108:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1789181438.977116:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:3303:x1876092510059264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181438.977158:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:3303:x1876092510059264:12345-0@lo:400:kworker.0 Request processed in 43us (1333us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181438.977164:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1789181438.977221:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfb46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:880710ad-110c-42a4-a174-ab1b99a7ebeb:3303:1876092510059264:0@lo:400:kworker.0 00000100:00100000:2.0:1789181438.981917:0:6887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510059520 00000100:00100000:2.0:1789181438.981933:0:6887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510059520 00000100:00100000:2.0:1789181438.982015:0:6887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789181438.982026:0:6887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876092510059776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181438.982143:0:6887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876092510059776:12345-0@lo:400:kworker.0 Request processed in 120us (6242us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181438.982151:0:6887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789181438.982169:0:6887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789181438.982176:0:6887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876092510059392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181438.982223:0:6887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876092510059392:12345-0@lo:400:kworker.0 Request processed in 48us (6277us total) trans 0 rc 0/0 00000100:00080000:1.0:1789181438.982354:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789181438.982861:0:6887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789181438.982883:0:6887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789181438.982892:0:6887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1baba4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876092510059520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181438.982950:0:6887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1baba4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876092510059520:12345-0@lo:400:kworker.0 Request processed in 60us (6807us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181438.982957:0:6887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789181438.983005:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfb45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876092510059392:0@lo:400:kworker.0 00000100:00100000:2.0:1789181438.983017:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfb46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1876092510059776:0@lo:400:kworker.0 00000100:00100000:1.0:1789181438.983110:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfb47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1876092510059520:0@lo:400:kworker.0 00000100:00100000:3.0:1789181439.488313:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc18854a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510060032:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789181439.488430:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181439.488620:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510060032 00000100:00100000:2.0:1789181439.488634:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510060032 00000100:00100000:2.0:1789181439.488694:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789181439.488705:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510060032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789181439.488764:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789181439.488812:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510060032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181439.488819:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:3.0:1789181439.489014:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc18854a680 x1876092510060032/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181455 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181439.489035:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc18854a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510060032:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789181439.550991:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181440.574431:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181441.600289:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181442.047019:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfb2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876092510060160:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789181442.047099:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181442.051554:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510060160 00000100:00100000:0.0:1789181442.051571:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510060160 00000100:00100000:0.0:1789181442.051706:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789181442.051721:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b66df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876092510060160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789181442.051767:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789181442.051891:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b66df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876092510060160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 175us (4791us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181442.051898:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:3.0:1789181442.053451:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc1bfb2df80 x1876092510060160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181458 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181442.053479:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfb2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876092510060160:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789181442.057462:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789181442.626953:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181443.168531:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181443.168574:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181443.168596:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181443.168614:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181443.168634:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181443.168725:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488005248 00000100:00100000:0.0:1789181443.168734:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488005248 00000100:00100000:0.0:1789181443.168796:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 227 00000100:00100000:0.0:1789181443.168807:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:975a0591-a8f7-4a74-9f93-a5aa77f2315c+13:2353:x1876092488005248:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:0.0:1789181443.168875:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:975a0591-a8f7-4a74-9f93-a5aa77f2315c+13:2353:x1876092488005248:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 71us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181443.168883:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 227 00000100:00100000:0.0:1789181443.168915:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488005632 00000100:00100000:0.0:1789181443.168918:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488005632 00000100:00100000:0.0:1789181443.168952:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488005760 00000100:00100000:0.0:1789181443.168956:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488005760 00000100:00100000:0.0:1789181443.168977:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 14 00000100:00100000:0.0:1789181443.168983:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b66ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7badad21-a177-49b1-a2af-7b11e28c02ce+5:2350:x1876092488005632:12345-192.168.204.32@tcp:9:kworker.0 00000020:00000080:0.0:1789181443.169004:0:6692:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8f4f7840b2e4120a 00000100:00080000:0.0:1789181443.169012:0:6692:0:(import.c:65:import_set_state_nolock()) ffff9dc1b670b800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789181443.169074:0:6692:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1789181443.169416:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b66ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7badad21-a177-49b1-a2af-7b11e28c02ce+2:2350:x1876092488005632:12345-192.168.204.32@tcp:9:kworker.0 Request processed in 432us (818us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181443.169424:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 14 00000100:00100000:0.0:1789181443.169437:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 15 00000100:00100000:0.0:1789181443.169444:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b66df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7badad21-a177-49b1-a2af-7b11e28c02ce+5:2350:x1876092488005760:12345-192.168.204.32@tcp:9:kworker.0 00000020:00000080:0.0:1789181443.169456:0:6692:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8f4f7840b2e41211 00000100:00080000:0.0:1789181443.169461:0:6692:0:(import.c:65:import_set_state_nolock()) ffff9dc1b670f000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789181443.169513:0:6692:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:1.0:1789181443.169548:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181443.169764:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b66df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7badad21-a177-49b1-a2af-7b11e28c02ce+2:2350:x1876092488005760:12345-192.168.204.32@tcp:9:kworker.0 Request processed in 319us (1127us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181443.169771:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 15 00000100:00080000:0.0:1789181443.169793:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789181443.169804:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789181443.169818:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181443.170934:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488005376 00000100:00100000:0.0:1789181443.170944:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488005376 00000100:00100000:0.0:1789181443.171003:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488005504 00000100:00100000:0.0:1789181443.171007:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488005504 00000100:00100000:0.0:1789181443.171033:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 83 00000100:00100000:0.0:1789181443.171041:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b66dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+6:2354:x1876092488005376:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:0.0:1789181443.171090:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b66dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+6:2354:x1876092488005376:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 50us (2514us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181443.171095:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 83 00000100:00100000:0.0:1789181443.171109:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 84 00000100:00100000:0.0:1789181443.171127:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b66dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7badad21-a177-49b1-a2af-7b11e28c02ce+5:2353:x1876092488005504:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:0.0:1789181443.171159:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b66dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7badad21-a177-49b1-a2af-7b11e28c02ce+5:2353:x1876092488005504:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 36us (2536us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181443.171165:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 84 00000100:00080000:2.0:1789181443.172419:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789181443.653948:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181444.094552:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc18854a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:880710ad-110c-42a4-a174-ab1b99a7ebeb:3303:1876092510060288:0@lo:400:kworker.0 00000100:00100000:2.0:1789181444.094649:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181444.094718:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc18854a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1876092510060800:0@lo:400:kworker.0 00000100:00100000:2.0:1789181444.094743:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181444.094770:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789181444.094776:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc188549880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876092510060416:0@lo:400:kworker.0 00000100:00100000:2.0:1789181444.094794:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181444.094810:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfa2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876092510060928:0@lo:400:kworker.0 00000100:00100000:2.0:1789181444.094830:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181444.095189:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510060288 00000100:00100000:2.0:1789181444.095198:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510060288 00000100:00100000:2.0:1789181444.095245:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1789181444.095254:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c270050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:3303:x1876092510060288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181444.095310:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c270050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:3303:x1876092510060288:12345-0@lo:400:kworker.0 Request processed in 56us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181444.095317:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1789181444.095373:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510060800 00000100:00100000:2.0:1789181444.095377:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510060800 00000100:00100000:2.0:1789181444.095409:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510060416 00000100:00100000:2.0:1789181444.095412:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510060416 00000100:00100000:2.0:1789181444.095439:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789181444.095445:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfa2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876092510060800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181444.095481:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfa2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876092510060800:12345-0@lo:400:kworker.0 Request processed in 36us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181444.095487:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789181444.095498:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789181444.095504:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfa2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876092510060416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181444.095529:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfa2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876092510060416:12345-0@lo:400:kworker.0 Request processed in 26us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181444.095536:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:2.0:1789181444.095555:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789181444.095591:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc188549880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876092510060416:0@lo:400:kworker.0 00000100:00100000:2.0:1789181444.095601:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc18854a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:880710ad-110c-42a4-a174-ab1b99a7ebeb:3303:1876092510060288:0@lo:400:kworker.0 00000100:00100000:2.0:1789181444.095609:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc18854a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1876092510060800:0@lo:400:kworker.0 00000100:00100000:3.0:1789181444.096702:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc188548700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1876092510060544:0@lo:400:kworker.0 00000100:00100000:3.0:1789181444.096750:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181444.096784:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789181444.096791:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc18854bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510060672:0@lo:400:kworker.0 00000100:00100000:3.0:1789181444.096813:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181444.096847:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510060544 00000100:00100000:3.0:1789181444.096852:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510060544 00000100:00100000:3.0:1789181444.096895:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789181444.096903:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876092510060544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181444.096962:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876092510060544:12345-0@lo:400:kworker.0 Request processed in 60us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181444.096970:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:3.0:1789181444.096997:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789181444.097003:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510060928 00000100:00100000:0.0:1789181444.097007:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510060928 00000100:00100000:3.0:1789181444.097027:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc188548700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1876092510060544:0@lo:400:kworker.0 00000100:00100000:0.0:1789181444.097045:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510060672 00000100:00080000:3.0:1789181444.097046:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789181444.097047:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510060672 00000100:00080000:3.0:1789181444.097065:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789181444.097074:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789181444.097081:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfa2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1876092510060928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181444.097145:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfa2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1876092510060928:12345-0@lo:400:kworker.0 Request processed in 65us (2314us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181444.097152:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789181444.097166:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789181444.097182:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510060672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181444.097226:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510060672:12345-0@lo:400:kworker.0 Request processed in 54us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181444.097232:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:0.0:1789181444.097269:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc18854bb80 x1876092510060672/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181460 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181444.097280:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc18854bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510060672:0@lo:400:kworker.0 00010000:00080000:3.0:1789181444.097671:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc1bfa2f100 x1876092510060928/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181460 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181444.097682:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfa2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876092510060928:0@lo:400:kworker.0 00000100:00100000:0.0:1789181444.607527:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfa2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510061056:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789181444.607608:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181444.607785:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510061056 00000100:00100000:2.0:1789181444.607797:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510061056 00000100:00100000:2.0:1789181444.607863:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789181444.607875:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1baba5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510061056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789181444.607915:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789181444.607979:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1baba5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510061056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181444.607986:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:2.0:1789181444.608025:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc1bfa2d880 x1876092510061056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181460 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181444.608042:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfa2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510061056:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789181444.679772:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181445.706387:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789181445.753703:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7badad21-a177-49b1-a2af-7b11e28c02ce 00000020:00000080:0.0:1789181445.753712:0:7647:0:(genops.c:885:class_export_put()) final put ffff9dc1b670c800/7badad21-a177-49b1-a2af-7b11e28c02ce 00000020:00000080:0.0:1789181445.753741:0:706:0:(genops.c:844:class_export_destroy()) destroying export ffff9dc1b670c800/7badad21-a177-49b1-a2af-7b11e28c02ce for lustre-OST0001 00000020:00000080:0.0:1789181445.753782:0:706:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9dc1b670f000 for lustre-OST0001 00000001:00100000:0.0:1789181446.261794:0:6718:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7badad21-a177-49b1-a2af-7b11e28c02ce 00000020:00000080:0.0:1789181446.261803:0:6718:0:(genops.c:885:class_export_put()) final put ffff9dc1b670b000/7badad21-a177-49b1-a2af-7b11e28c02ce 00000020:00000080:0.0:1789181446.261834:0:706:0:(genops.c:844:class_export_destroy()) destroying export ffff9dc1b670b000/7badad21-a177-49b1-a2af-7b11e28c02ce for lustre-OST0000 00000020:00000080:0.0:1789181446.261875:0:706:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9dc1b670b800 for lustre-OST0000 00010000:00010000:0.0:1789181446.719185:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181447.169352:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfa2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876092510061184:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789181447.169420:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181447.169514:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510061184 00000100:00100000:0.0:1789181447.169522:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510061184 00000100:00100000:0.0:1789181447.169576:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789181447.169585:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b66dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876092510061184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789181447.169629:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1789181447.175088:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789181447.177381:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b66dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876092510061184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 7785us (7948us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181447.177408:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:1.0:1789181447.178870:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc1bfa2d880 x1876092510061184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181463 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181447.178896:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfa2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876092510061184:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1789181447.524225:0:11029:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1789181447.744369:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789181448.278384:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181448.278443:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181448.278477:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181448.278575:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488005888 00000100:00100000:1.0:1789181448.278598:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488005888 00000100:00100000:2.0:1789181448.278604:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488006144 00000100:00100000:2.0:1789181448.278608:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488006144 00000100:00100000:2.0:1789181448.278649:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488006016 00000100:00100000:1.0:1789181448.278649:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 229 00000100:00100000:2.0:1789181448.278651:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488006016 00000100:00100000:1.0:1789181448.278659:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c270450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:975a0591-a8f7-4a74-9f93-a5aa77f2315c+13:2354:x1876092488005888:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:2.0:1789181448.278669:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 88 00000100:00100000:2.0:1789181448.278674:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7badad21-a177-49b1-a2af-7b11e28c02ce+5:2354:x1876092488006144:12345-192.168.204.32@tcp:400:kworker.0 00000100:00080000:3.0:1789181448.278734:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789181448.278749:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 89 00000100:00100000:3.0:1789181448.278758:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+6:2354:x1876092488006016:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:2.0:1789181448.278819:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7badad21-a177-49b1-a2af-7b11e28c02ce+5:2354:x1876092488006144:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 144us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181448.278829:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 88 00000100:00100000:1.0:1789181448.283273:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c270450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:975a0591-a8f7-4a74-9f93-a5aa77f2315c+13:2354:x1876092488005888:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 4603us (4886us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181448.283289:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 229 00000100:00100000:3.0:1789181448.290057:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+6:2354:x1876092488006016:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 11282us (11559us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181448.290074:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 89 00010000:00010000:0.0:1789181448.767639:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181449.214588:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfa2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1876092510061568:0@lo:400:kworker.0 00000100:00100000:2.0:1789181449.214657:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181449.214722:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789181449.214729:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfa2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510061696:0@lo:400:kworker.0 00000100:00100000:2.0:1789181449.214754:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181449.214788:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510061568 00000100:00100000:2.0:1789181449.214795:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510061568 00000100:00100000:2.0:1789181449.214844:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789181449.214853:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc188548700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876092510061568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181449.214897:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc188548700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876092510061568:12345-0@lo:400:kworker.0 Request processed in 46us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181449.214904:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789181449.215199:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfa2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:880710ad-110c-42a4-a174-ab1b99a7ebeb:3303:1876092510061312:0@lo:400:kworker.0 00000100:00100000:3.0:1789181449.215232:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181449.215265:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfa2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1876092510061824:0@lo:400:kworker.0 00000100:00100000:3.0:1789181449.215286:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181449.215306:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789181449.215312:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfa2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876092510061440:0@lo:400:kworker.0 00000100:00100000:3.0:1789181449.215355:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181449.215371:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc18854bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876092510061952:0@lo:400:kworker.0 00000100:00100000:3.0:1789181449.215390:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789181449.215412:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789181449.215423:0:6887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510061824 00000100:00100000:3.0:1789181449.215426:0:6887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510061824 00000100:00100000:3.0:1789181449.215456:0:6887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510061440 00000100:00100000:3.0:1789181449.215459:0:6887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510061440 00000100:00100000:3.0:1789181449.215474:0:6887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789181449.215480:0:6887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876092510061824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181449.215515:0:6887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876092510061824:12345-0@lo:400:kworker.0 Request processed in 35us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181449.215538:0:6887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789181449.215551:0:6887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789181449.215572:0:6887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876092510061440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181449.215603:0:6887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876092510061440:12345-0@lo:400:kworker.0 Request processed in 47us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181449.215609:0:6887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789181449.215629:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510061696 00000100:00100000:3.0:1789181449.215632:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510061696 00000100:00100000:3.0:1789181449.215657:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510061952 00000100:00100000:3.0:1789181449.215660:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510061952 00000100:00100000:3.0:1789181449.215678:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789181449.215684:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc18854a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510061696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181449.215711:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc18854a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510061696:12345-0@lo:400:kworker.0 Request processed in 28us (957us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181449.215717:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789181449.215727:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789181449.215732:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1876092510061952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181449.215758:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1876092510061952:12345-0@lo:400:kworker.0 Request processed in 26us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181449.215765:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:3.0:1789181449.215783:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789181449.215785:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789181449.215787:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789181449.215813:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfa2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876092510061440:0@lo:400:kworker.0 00010000:00080000:3.0:1789181449.215826:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc18854bb80 x1876092510061952/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181465 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181449.215847:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc18854bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876092510061952:0@lo:400:kworker.0 00000100:00100000:3.0:1789181449.215860:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfa2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1876092510061824:0@lo:400:kworker.0 00000100:00100000:1.0:1789181449.219841:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510061312 00000100:00100000:1.0:1789181449.219857:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510061312 00000100:00100000:1.0:1789181449.219944:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1789181449.219955:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c271c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:3303:x1876092510061312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181449.220068:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c271c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:3303:x1876092510061312:12345-0@lo:400:kworker.0 Request processed in 115us (4834us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181449.220075:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1789181449.220137:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfa2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:880710ad-110c-42a4-a174-ab1b99a7ebeb:3303:1876092510061312:0@lo:400:kworker.0 00000100:00100000:2.0:1789181449.222659:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfa2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1876092510061568:0@lo:400:kworker.0 00010000:00080000:2.0:1789181449.222702:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc1bfa2d880 x1876092510061696/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181465 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181449.222713:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfa2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510061696:0@lo:400:kworker.0 00000100:00100000:3.0:1789181449.735817:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfb2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510062080:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789181449.735892:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181449.735986:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510062080 00000100:00100000:3.0:1789181449.736004:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510062080 00000100:00100000:3.0:1789181449.736057:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789181449.736067:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510062080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789181449.736101:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789181449.736144:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510062080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181449.736150:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:3.0:1789181449.736192:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc1bfb2f800 x1876092510062080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181465 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181449.736210:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfb2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510062080:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789181449.791471:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181450.814643:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789181451.535547:0:11177:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff51c40370 20000000:00000080:0.0:1789181451.535563:0:11177:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9dc1bfba7c00 uarg=0000000000000000 20000000:01000000:0.0:1789181451.535602:0:11177:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789181451.535607:0:11177:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789181451.535612:0:11177:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1789181451.536573:0:11178:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:0.0:1789181451.536819:0:11177:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1789181451.549524:0:11177:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789181451.549736:0:11177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dc1ba784200/0x8f4f7840b2e41218 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181451.549759:0:11177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dc180031600/0x8f4f7840b2e411bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91ef6f expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181451.549769:0:11177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dc1bfa1f800/0x8f4f7840b2e411cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e411c4 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181451.549775:0:11177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dc1bfa1fa00/0x8f4f7840b2e411d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e411d2 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181451.549782:0:11177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dc1bfa1fc00/0x8f4f7840b2e411e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e411e0 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181451.549788:0:11177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dc1c2045400/0x8f4f7840b2e411fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91efa7 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181451.549794:0:11177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9dc1ba784200/0x8f4f7840b2e41218 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181451.549840:0:11177:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dc1c2045400/0x8f4f7840b2e411fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91efa7 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181451.549856:0:11177:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dc1c2045400/0x8f4f7840b2e411fc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91efa7 expref: 12 pid: 5835 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181451.549872:0:11177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc18854a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11177:1876092510062208:192.168.204.32@tcp:104: 00010000:00010000:2.0:1789181451.549997:0:11177:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dc1bfa1fc00/0x8f4f7840b2e411e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8f4f7840b2e411e0 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181451.550024:0:11177:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dc1bfa1fc00/0x8f4f7840b2e411e7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8f4f7840b2e411e0 expref: 18 pid: 5835 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181451.550034:0:11177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc188549880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11177:1876092510062336:0@lo:104: 00000100:00100000:2.0:1789181451.550074:0:11177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789181451.550124:0:11177:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dc1bfa1fa00/0x8f4f7840b2e411d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8f4f7840b2e411d2 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181451.550132:0:11177:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dc1bfa1fa00/0x8f4f7840b2e411d9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8f4f7840b2e411d2 expref: 18 pid: 5836 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181451.550140:0:11177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfa60700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11177:1876092510062464:0@lo:104: 00000100:00100000:2.0:1789181451.550162:0:11177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789181451.550194:0:11177:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dc1bfa1f800/0x8f4f7840b2e411cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8f4f7840b2e411c4 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181451.550202:0:11177:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dc1bfa1f800/0x8f4f7840b2e411cb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8f4f7840b2e411c4 expref: 18 pid: 5837 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181451.550209:0:11177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfa62680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11177:1876092510062592:0@lo:104: 00000100:00100000:2.0:1789181451.550229:0:11177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789181451.550245:0:11177:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dc180031600/0x8f4f7840b2e411bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91ef6f expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181451.550253:0:11177:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dc180031600/0x8f4f7840b2e411bd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91ef6f expref: 12 pid: 5835 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181451.550261:0:11177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfa60000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11177:1876092510062720:192.168.204.32@tcp:104: 00000100:00100000:2.0:1789181451.550292:0:11177:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc18985d3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789181451.550509:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510062336 00000100:00100000:3.0:1789181451.550519:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510062336 00000100:00100000:3.0:1789181451.550566:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510062464 00000100:00100000:3.0:1789181451.550569:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510062464 00000100:00100000:3.0:1789181451.550581:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510062592 00000100:00100000:3.0:1789181451.550583:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510062592 00000100:00100000:3.0:1789181451.550597:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789181451.550605:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc18854bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:880710ad-110c-42a4-a174-ab1b99a7ebeb+5:11177:x1876092510062336:12345-0@lo:104: 00010000:00010000:3.0:1789181451.550625:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.132@tcp lock: ffff9dc1ba785200/0x8f4f7840b2e411e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f4f7840b2e411e7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181451.550684:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789181451.550691:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc18854bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:880710ad-110c-42a4-a174-ab1b99a7ebeb+5:11177:x1876092510062336:12345-0@lo:104: Request processed in 86us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181451.550698:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789181451.550770:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789181451.550777:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfa61500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:880710ad-110c-42a4-a174-ab1b99a7ebeb+4:11177:x1876092510062464:12345-0@lo:104: 00010000:00010000:3.0:1789181451.550785:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.132@tcp lock: ffff9dc1ba785a00/0x8f4f7840b2e411d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f4f7840b2e411d9 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181451.550818:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789181451.550823:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfa61500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:880710ad-110c-42a4-a174-ab1b99a7ebeb+4:11177:x1876092510062464:12345-0@lo:104: Request processed in 48us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181451.550829:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789181451.550841:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789181451.550846:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfa63480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:880710ad-110c-42a4-a174-ab1b99a7ebeb+3:11177:x1876092510062592:12345-0@lo:104: 00010000:00010000:3.0:1789181451.550852:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.132@tcp lock: ffff9dc1ba785800/0x8f4f7840b2e411c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f4f7840b2e411cb expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181451.550877:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789181451.550881:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfa63480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:880710ad-110c-42a4-a174-ab1b99a7ebeb+3:11177:x1876092510062592:12345-0@lo:104: Request processed in 36us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181451.550886:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:3.0:1789181451.550901:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789181451.550906:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.132@tcp lock: ffff9dc1ba785200/0x8f4f7840b2e411e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f4f7840b2e411e7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181451.550918:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1ba785200 already unused, calling callback (ffffffffc1b45c20) 10000000:00010000:3.0:1789181451.550922:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.132@tcp lock: ffff9dc1ba785200/0x8f4f7840b2e411e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8f4f7840b2e411e7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181451.550930:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.132@tcp lock: ffff9dc1ba785200/0x8f4f7840b2e411e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8f4f7840b2e411e7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789181451.550937:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.132@tcp lock: ffff9dc1ba785200/0x8f4f7840b2e411e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8f4f7840b2e411e7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789181451.550964:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789181451.550992:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.132@tcp lock: ffff9dc1ba785200/0x8f4f7840b2e411e0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e411e7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181451.550999:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789181451.551017:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.132@tcp lock: ffff9dc1ba785200/0x8f4f7840b2e411e0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e411e7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181451.551024:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.132@tcp lock: ffff9dc1ba785200/0x8f4f7840b2e411e0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e411e7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181451.551037:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789181451.551040:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.132@tcp lock: ffff9dc1ba785a00/0x8f4f7840b2e411d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f4f7840b2e411d9 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181451.551045:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1ba785a00 already unused, calling callback (ffffffffc1b45c20) 10000000:00010000:3.0:1789181451.551048:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.132@tcp lock: ffff9dc1ba785a00/0x8f4f7840b2e411d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8f4f7840b2e411d9 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181451.551065:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.132@tcp lock: ffff9dc1ba785a00/0x8f4f7840b2e411d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8f4f7840b2e411d9 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789181451.551071:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.132@tcp lock: ffff9dc1ba785a00/0x8f4f7840b2e411d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8f4f7840b2e411d9 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789181451.551076:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789181451.551092:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.132@tcp lock: ffff9dc1ba785a00/0x8f4f7840b2e411d2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e411d9 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181451.551098:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789181451.551114:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.132@tcp lock: ffff9dc1ba785a00/0x8f4f7840b2e411d2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e411d9 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181451.551121:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.132@tcp lock: ffff9dc1ba785a00/0x8f4f7840b2e411d2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e411d9 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181451.551131:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789181451.551134:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.132@tcp lock: ffff9dc1ba785800/0x8f4f7840b2e411c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f4f7840b2e411cb expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181451.551139:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1ba785800 already unused, calling callback (ffffffffc1b45c20) 10000000:00010000:3.0:1789181451.551142:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.132@tcp lock: ffff9dc1ba785800/0x8f4f7840b2e411c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8f4f7840b2e411cb expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181451.551148:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.132@tcp lock: ffff9dc1ba785800/0x8f4f7840b2e411c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8f4f7840b2e411cb expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789181451.551154:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.132@tcp lock: ffff9dc1ba785800/0x8f4f7840b2e411c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8f4f7840b2e411cb expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789181451.551167:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789181451.551180:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.132@tcp lock: ffff9dc1ba785800/0x8f4f7840b2e411c4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e411cb expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181451.551186:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789181451.551191:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.132@tcp lock: ffff9dc1ba785800/0x8f4f7840b2e411c4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e411cb expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181451.551197:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.132@tcp lock: ffff9dc1ba785800/0x8f4f7840b2e411c4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e411cb expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181451.551210:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181451.551211:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181451.551213:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181451.551220:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789181451.551239:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfb2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:880710ad-110c-42a4-a174-ab1b99a7ebeb:3306:1876092510062848:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789181451.551269:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181451.551306:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfa2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:880710ad-110c-42a4-a174-ab1b99a7ebeb:3303:1876092510062976:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789181451.551326:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181451.551364:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789181451.551370:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfa2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:880710ad-110c-42a4-a174-ab1b99a7ebeb:3303:1876092510063104:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789181451.551389:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181451.551411:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510062848 00000100:00100000:3.0:1789181451.551415:0:8456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510062848 00010000:00010000:3.0:1789181451.551434:0:8456:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dc1bfa1fc00/0x8f4f7840b2e411e7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f4f7840b2e411e0 expref: 19 pid: 5835 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181451.551453:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510062976 00000100:00100000:3.0:1789181451.551462:0:8456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510062976 00010000:00010000:3.0:1789181451.551478:0:8456:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dc1bfa1fa00/0x8f4f7840b2e411d9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f4f7840b2e411d2 expref: 20 pid: 5836 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181451.551492:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510063104 00000100:00100000:3.0:1789181451.551496:0:8456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510063104 00010000:00010000:3.0:1789181451.551507:0:8456:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dc1bfa1f800/0x8f4f7840b2e411cb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f4f7840b2e411c4 expref: 21 pid: 5837 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181451.551517:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789181451.551522:0:8456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1960f3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:880710ad-110c-42a4-a174-ab1b99a7ebeb+21:3306:x1876092510062848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789181451.551531:0:8456:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789181451.551535:0:8456:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dc1bfa1fc00/0x8f4f7840b2e411e7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f4f7840b2e411e0 expref: 21 pid: 5835 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181451.551544:0:8456:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dc1bfa1fc00/0x8f4f7840b2e411e7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8f4f7840b2e411e0 expref: 21 pid: 5835 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181451.551557:0:8456:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789181451.551581:0:8456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1960f3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:880710ad-110c-42a4-a174-ab1b99a7ebeb+21:3306:x1876092510062848:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181451.551587:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789181451.551620:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789181451.551627:0:8456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfa2d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:880710ad-110c-42a4-a174-ab1b99a7ebeb+20:3303:x1876092510062976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789181451.551633:0:8456:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789181451.551637:0:8456:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dc1bfa1fa00/0x8f4f7840b2e411d9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f4f7840b2e411d2 expref: 20 pid: 5836 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181451.551645:0:8456:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dc1bfa1fa00/0x8f4f7840b2e411d9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8f4f7840b2e411d2 expref: 20 pid: 5836 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181451.551663:0:8456:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789181451.551688:0:8456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfa2d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:880710ad-110c-42a4-a174-ab1b99a7ebeb+20:3303:x1876092510062976:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181451.551694:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789181451.551705:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789181451.551879:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfb2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:880710ad-110c-42a4-a174-ab1b99a7ebeb:3306:1876092510062848:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789181451.552573:0:11177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc1bfa1fc00/0x8f4f7840b2e411e7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8f4f7840b2e411e0 expref: 19 pid: 5835 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181451.552590:0:11177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc188549880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11177:1876092510062336:0@lo:104: 00010000:00010000:2.0:1789181451.552601:0:11177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc1bfa1fa00/0x8f4f7840b2e411d9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8f4f7840b2e411d2 expref: 18 pid: 5836 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181451.552609:0:11177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfa60700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11177:1876092510062464:0@lo:104: 00000100:00100000:2.0:1789181451.552617:0:11177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfa62680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11177:1876092510062592:0@lo:104: 00000100:00100000:3.0:1789181451.557841:0:8456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfa2f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:3303:x1876092510063104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789181451.557876:0:8456:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789181451.557888:0:8456:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dc1bfa1f800/0x8f4f7840b2e411cb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f4f7840b2e411c4 expref: 17 pid: 5837 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181451.557901:0:8456:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dc1bfa1f800/0x8f4f7840b2e411cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8f4f7840b2e411c4 expref: 17 pid: 5837 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181451.557919:0:8456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc1bfa1f800/0x8f4f7840b2e411cb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8f4f7840b2e411c4 expref: 17 pid: 5837 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181451.557936:0:8456:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789181451.558099:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfa2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:880710ad-110c-42a4-a174-ab1b99a7ebeb:3303:1876092510062976:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789181451.558412:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181451.558476:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181451.558501:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488006272 00000100:00100000:0.0:1789181451.558509:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488006272 00010000:00010000:0.0:1789181451.558539:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dc1c2045400/0x8f4f7840b2e411fc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91efa7 expref: 13 pid: 5835 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181451.558566:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488006400 00000100:00100000:0.0:1789181451.558570:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488006400 00010000:00010000:0.0:1789181451.558581:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dc180031600/0x8f4f7840b2e411bd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91ef6f expref: 14 pid: 5835 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181451.558600:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 28 00000100:00100000:0.0:1789181451.558608:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb47800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:975a0591-a8f7-4a74-9f93-a5aa77f2315c+14:2353:x1876092488006272:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789181451.558618:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789181451.558622:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dc1c2045400/0x8f4f7840b2e411fc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91efa7 expref: 14 pid: 5835 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181451.558650:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dc1c2045400/0x8f4f7840b2e411fc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91efa7 expref: 14 pid: 5835 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181451.558661:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789181451.558699:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb47800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:975a0591-a8f7-4a74-9f93-a5aa77f2315c+14:2353:x1876092488006272:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 91us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181451.558707:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 28 00000100:00100000:0.0:1789181451.558737:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 29 00000100:00100000:0.0:1789181451.558744:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb46680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:975a0591-a8f7-4a74-9f93-a5aa77f2315c+13:2353:x1876092488006400:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789181451.558751:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789181451.558755:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dc180031600/0x8f4f7840b2e411bd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91ef6f expref: 13 pid: 5835 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181451.558764:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dc180031600/0x8f4f7840b2e411bd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91ef6f expref: 13 pid: 5835 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181451.558776:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9dc1ba784200/0x8f4f7840b2e41218 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181451.558785:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc1ba784200/0x8f4f7840b2e41218 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181451.558799:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dc1ba784200/0x8f4f7840b2e41218 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181451.558806:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dc1ba784200/0x8f4f7840b2e41218 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181451.558813:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dc1ba784200/0x8f4f7840b2e41218 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181451.558826:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dc1ba784200/0x8f4f7840b2e41218 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181451.558833:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1ba784200 already unused, calling callback (ffffffffc152f9b0) 00010000:00010000:0.0:1789181451.558836:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dc1ba784200/0x8f4f7840b2e41218 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181451.558845:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dc1ba784200/0x8f4f7840b2e41218 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181451.558854:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dc1ba784200/0x8f4f7840b2e41218 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181451.558865:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789181451.558884:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb46680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:975a0591-a8f7-4a74-9f93-a5aa77f2315c+13:2353:x1876092488006400:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 142us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181451.558891:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 29 00000100:00100000:3.0:1789181451.559136:0:8456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfa2f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:880710ad-110c-42a4-a174-ab1b99a7ebeb+16:3303:x1876092510063104:12345-0@lo:103:ldlm_bl.0 Request processed in 7424us (7744us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181451.559144:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:1.0:1789181451.561544:0:11177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc1c2045400/0x8f4f7840b2e411fc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91efa7 expref: 12 pid: 5835 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181451.561568:0:11177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc18854a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11177:1876092510062208:192.168.204.32@tcp:104: 00010000:00010000:1.0:1789181451.561582:0:11177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc180031600/0x8f4f7840b2e411bd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91ef6f expref: 11 pid: 5835 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181451.561591:0:11177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfa60000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11177:1876092510062720:192.168.204.32@tcp:104: 00010000:00010000:1.0:1789181451.561623:0:11177:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9dc1ba784200/0x8f4f7840b2e41218 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181451.561634:0:11177:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9dc1ba784200/0x8f4f7840b2e41218 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181451.561641:0:11177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dc1ba784200/0x8f4f7840b2e41218 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181451.561647:0:11177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc1ba784200/0x8f4f7840b2e41218 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181451.563296:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfa2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:880710ad-110c-42a4-a174-ab1b99a7ebeb:3303:1876092510063104:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789181451.845602:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789181452.299420:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfa62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510063232:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789181452.299508:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181452.299876:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510063232 00000100:00100000:1.0:1789181452.299886:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510063232 00000100:00100000:1.0:1789181452.300011:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789181452.300023:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfa2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510063232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789181452.300065:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789181452.300127:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfa2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510063232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181452.300134:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:0.0:1789181452.300315:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc1bfa62a00 x1876092510063232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181468 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181452.300358:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfa62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510063232:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789181452.300522:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789181452.863783:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181453.146617:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181453.147074:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488006528 00000100:00100000:2.0:1789181453.147085:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488006528 00000100:00100000:2.0:1789181453.147138:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 231 00000100:00100000:2.0:1789181453.147148:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c272c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:975a0591-a8f7-4a74-9f93-a5aa77f2315c+11:5594:x1876092488006528:12345-192.168.204.32@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789181453.147168:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181453.147189:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc1ba785400/0x8f4f7840b2e4121f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91efd1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181453.147221:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc1ba785400/0x8f4f7840b2e4121f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91efd1 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181453.147234:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc1ba785400/0x8f4f7840b2e4121f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91efd1 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181453.147244:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1ba785400, rc 0) 00000100:00100000:2.0:1789181453.147358:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c272c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:975a0591-a8f7-4a74-9f93-a5aa77f2315c+12:5594:x1876092488006528:12345-192.168.204.32@tcp:101:ll_cfg_requeue.0 Request processed in 182us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181453.147366:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 231 00000100:00100000:0.0:1789181453.150782:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181453.151067:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488006656 00000100:00100000:3.0:1789181453.151078:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488006656 00000100:00100000:3.0:1789181453.151131:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 232 00000100:00100000:3.0:1789181453.151153:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:975a0591-a8f7-4a74-9f93-a5aa77f2315c+12:5594:x1876092488006656:12345-192.168.204.32@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789181453.152257:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:975a0591-a8f7-4a74-9f93-a5aa77f2315c+12:5594:x1876092488006656:12345-192.168.204.32@tcp:501:ll_cfg_requeue.0 Request processed in 1101us (1481us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181453.155585:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 232 00000100:00100000:3.0:1789181453.161083:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181453.161503:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488006784 00000100:00100000:0.0:1789181453.161514:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488006784 00000100:00100000:0.0:1789181453.161575:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 233 00000100:00100000:0.0:1789181453.161586:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:975a0591-a8f7-4a74-9f93-a5aa77f2315c+12:5594:x1876092488006784:12345-192.168.204.32@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789181453.161834:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:975a0591-a8f7-4a74-9f93-a5aa77f2315c+12:5594:x1876092488006784:12345-192.168.204.32@tcp:503:ll_cfg_requeue.0 Request processed in 248us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181453.161849:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 233 00000100:00100000:0.0:1789181453.172795:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181453.173979:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488006912 00000100:00100000:3.0:1789181453.173993:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488006912 00000100:00100000:3.0:1789181453.174189:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 234 00000100:00100000:3.0:1789181453.174204:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:975a0591-a8f7-4a74-9f93-a5aa77f2315c+12:5594:x1876092488006912:12345-192.168.204.32@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789181453.174223:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181453.174245:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc1bfa1ea00/0x8f4f7840b2e41226 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91efd8 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181453.174560:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc1bfa1ea00/0x8f4f7840b2e41226 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91efd8 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181453.174574:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc1bfa1ea00/0x8f4f7840b2e41226 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91efd8 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181453.174583:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1bfa1ea00, rc 0) 00000100:00100000:3.0:1789181453.174655:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:975a0591-a8f7-4a74-9f93-a5aa77f2315c+13:5594:x1876092488006912:12345-192.168.204.32@tcp:101:ll_cfg_requeue.0 Request processed in 456us (1870us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181453.174663:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 234 00000100:00100000:0.0:1789181453.177416:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181453.177540:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488007040 00000100:00100000:2.0:1789181453.177550:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488007040 00000100:00100000:2.0:1789181453.177605:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 235 00000100:00100000:2.0:1789181453.177616:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:975a0591-a8f7-4a74-9f93-a5aa77f2315c+13:5594:x1876092488007040:12345-192.168.204.32@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789181453.177897:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:975a0591-a8f7-4a74-9f93-a5aa77f2315c+13:5594:x1876092488007040:12345-192.168.204.32@tcp:501:ll_cfg_requeue.0 Request processed in 283us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181453.177905:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 235 00000100:00100000:2.0:1789181453.184812:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 10000000:01000000:3.0:1789181453.185620:0:5840:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789181453.185626:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9dc08132f800 from 7 10000000:01000000:3.0:1789181453.185630:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789181453.185682:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1f800/0x8f4f7840b2e4122d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181453.185707:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1f800/0x8f4f7840b2e4122d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181453.185722:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1f800/0x8f4f7840b2e4122d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181453.185745:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfa2dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510063360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789181453.185798:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181453.185851:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc181254180 going to sleep for 11 seconds 00000100:00100000:1.0:1789181453.186088:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488007168 00000100:00100000:1.0:1789181453.186098:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488007168 00000100:00100000:1.0:1789181453.186143:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510063360 00000100:00100000:1.0:1789181453.186146:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510063360 00000100:00100000:1.0:1789181453.186163:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 236 00000100:00100000:1.0:1789181453.186173:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:975a0591-a8f7-4a74-9f93-a5aa77f2315c+13:5594:x1876092488007168:12345-192.168.204.32@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789181453.186534:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1789181453.186545:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c371c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+16:5840:x1876092510063360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789181453.186555:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181453.186569:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc180030200/0x8f4f7840b2e41234 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f4f7840b2e4122d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181453.186594:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc180030200/0x8f4f7840b2e41234 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f4f7840b2e4122d expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181453.186605:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc180030200/0x8f4f7840b2e41234 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e4122d expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181453.186614:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc180030200, rc 0) 00000100:00100000:0.0:1789181453.186665:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c371c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+17:5840:x1876092510063360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (865us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181453.186670:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1789181453.186724:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfa2dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510063360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789181453.186739:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1f800/0x8f4f7840b2e4122d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e41234 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181453.186747:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1f800/0x8f4f7840b2e4122d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f4f7840b2e41234 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181453.186804:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfb45180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510063488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789181453.186840:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181453.186863:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1ba42f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789181453.186873:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510063488 00000100:00100000:0.0:1789181453.186877:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510063488 00000100:00100000:0.0:1789181453.186897:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1789181453.186902:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c370450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+17:5840:x1876092510063488:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789181453.187127:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c370450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+17:5840:x1876092510063488:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 224us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181453.187134:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1789181453.187164:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfb45180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510063488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789181453.187190:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfb45180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510063616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789181453.187229:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181453.187243:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1ba42f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789181453.187253:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510063616 00000100:00100000:0.0:1789181453.187257:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510063616 00000100:00100000:0.0:1789181453.187273:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1789181453.187278:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c372c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+17:5840:x1876092510063616:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789181453.187423:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c372c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+17:5840:x1876092510063616:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 144us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181453.187430:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1789181453.187468:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfb45180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510063616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789181453.187882:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:975a0591-a8f7-4a74-9f93-a5aa77f2315c+13:5594:x1876092488007168:12345-192.168.204.32@tcp:503:ll_cfg_requeue.0 Request processed in 1708us (3078us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181453.187889:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 236 00000040:00080000:1.0:1789181453.192912:0:11210:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1789181453.194124:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1789181453.194150:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789181453.194162:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1f800/0x8f4f7840b2e4122d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e41234 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181453.194190:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1f800/0x8f4f7840b2e4122d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e41234 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789181453.194201:0:5840:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789181453.194204:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9dc189d1d800 from 7 10000000:01000000:0.0:1789181453.194206:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789181453.194244:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc180031800/0x8f4f7840b2e4123b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181453.194251:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.132@tcp lock: ffff9dc180031800/0x8f4f7840b2e4123b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181453.195149:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.132@tcp lock: ffff9dc180031800/0x8f4f7840b2e4123b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181453.195181:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfb45180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510063744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789181453.195250:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181453.196764:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1ba42f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789181453.203719:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510063744 00000100:00100000:1.0:1789181453.203734:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510063744 00000100:00100000:0.0:1789181453.205691:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1789181453.205705:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c370c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+17:5840:x1876092510063744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789181453.205722:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181453.205741:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc180031c00/0x8f4f7840b2e41242 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f4f7840b2e4123b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181453.205769:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc180031c00/0x8f4f7840b2e41242 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f4f7840b2e4123b expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181453.205780:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc180031c00/0x8f4f7840b2e41242 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e4123b expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181453.205801:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc180031c00, rc 0) 00000100:00100000:0.0:1789181453.205879:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c370c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+18:5840:x1876092510063744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 179us (10628us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181453.205886:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1789181453.205958:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfb45180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510063744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789181453.205988:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.132@tcp lock: ffff9dc180031800/0x8f4f7840b2e4123b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e41242 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181453.205998:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.132@tcp lock: ffff9dc180031800/0x8f4f7840b2e4123b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f4f7840b2e41242 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181453.207551:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfb45180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510063872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789181453.207609:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181453.207652:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1ba42f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789181453.207790:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510063872 00000100:00100000:2.0:1789181453.207799:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510063872 00000100:00100000:2.0:1789181453.207845:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1789181453.207852:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c371450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+18:5840:x1876092510063872:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789181453.208147:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c371450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+18:5840:x1876092510063872:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 294us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181453.208154:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1789181453.208722:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfb45180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510063872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789181453.208762:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfb45180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510064000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789181453.208806:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181453.208837:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1ba42f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789181453.208853:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510064000 00000100:00100000:0.0:1789181453.208857:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510064000 00000100:00100000:0.0:1789181453.208881:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1789181453.208887:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c371050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+18:5840:x1876092510064000:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789181453.209520:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c371050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+18:5840:x1876092510064000:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 631us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181453.209540:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1789181453.213174:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfb45180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510064000:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789181453.238236:0:11212:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1789181453.240152:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1789181453.240185:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789181453.240198:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc180031800/0x8f4f7840b2e4123b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e41242 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181453.240223:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.132@tcp lock: ffff9dc180031800/0x8f4f7840b2e4123b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e41242 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789181453.240236:0:5840:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789181453.240239:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9dc1add60800 from 7 10000000:01000000:1.0:1789181453.240241:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789181453.240420:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc1c2044800/0x8f4f7840b2e41249 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181453.240430:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.132@tcp lock: ffff9dc1c2044800/0x8f4f7840b2e41249 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181453.240441:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.132@tcp lock: ffff9dc1c2044800/0x8f4f7840b2e41249 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181453.240469:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b66dea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510064128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789181453.240611:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181453.240654:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1bfab46c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789181453.240715:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510064128 00000100:00100000:3.0:1789181453.240723:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510064128 00000100:00100000:3.0:1789181453.240776:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1789181453.240787:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c371850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+18:5840:x1876092510064128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789181453.240802:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181453.240815:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc1bfa1fe00/0x8f4f7840b2e41250 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f4f7840b2e41249 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181453.240839:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc1bfa1fe00/0x8f4f7840b2e41250 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f4f7840b2e41249 expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181453.240850:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc1bfa1fe00/0x8f4f7840b2e41250 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e41249 expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181453.240858:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1bfa1fe00, rc 0) 00000100:00100000:3.0:1789181453.240896:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c371850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:5840:x1876092510064128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181453.240903:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1789181453.241060:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b66dea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510064128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789181453.241076:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.132@tcp lock: ffff9dc1c2044800/0x8f4f7840b2e41249 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e41250 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181453.241085:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.132@tcp lock: ffff9dc1c2044800/0x8f4f7840b2e41249 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f4f7840b2e41250 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181453.241134:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b66dea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510064256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789181453.241162:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181453.241220:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1bfab46c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789181453.248162:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510064256 00000100:00100000:3.0:1789181453.248178:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510064256 00000100:00100000:3.0:1789181453.250070:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1789181453.250091:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c372450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:5840:x1876092510064256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789181453.250708:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c372450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:5840:x1876092510064256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 623us (9543us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181453.250716:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1789181453.251027:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b66dea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510064256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789181453.251085:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b66dea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510064384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789181453.251131:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181453.251172:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1bfab46c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789181453.251281:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510064384 00000100:00100000:2.0:1789181453.251289:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510064384 00000100:00100000:2.0:1789181453.251353:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1789181453.251363:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c373450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:5840:x1876092510064384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789181453.251524:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c373450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:5840:x1876092510064384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 163us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181453.251531:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1789181453.251765:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b66dea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510064384:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789181453.268062:0:11216:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1789181453.271070:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1789181453.271107:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789181453.271119:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc1c2044800/0x8f4f7840b2e41249 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e41250 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181453.271133:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.132@tcp lock: ffff9dc1c2044800/0x8f4f7840b2e41249 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e41250 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181453.397855:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181453.397897:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181453.397988:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488007424 00000100:00100000:2.0:1789181453.397998:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488007424 00000100:00100000:2.0:1789181453.398069:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488007296 00000100:00100000:2.0:1789181453.398072:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488007296 00000100:00100000:2.0:1789181453.398096:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 93 00000100:00100000:2.0:1789181453.398105:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7badad21-a177-49b1-a2af-7b11e28c02ce+5:2354:x1876092488007424:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:2.0:1789181453.398173:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7badad21-a177-49b1-a2af-7b11e28c02ce+5:2354:x1876092488007424:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 70us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181453.398181:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 93 00000100:00100000:2.0:1789181453.398198:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 94 00000100:00100000:2.0:1789181453.398205:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+6:2354:x1876092488007296:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:2.0:1789181453.398227:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+6:2354:x1876092488007296:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 23us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181453.398233:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 94 00000100:00080000:0.0:1789181453.398491:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789181453.887754:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789181454.334525:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfa63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:880710ad-110c-42a4-a174-ab1b99a7ebeb:3306:1876092510064512:0@lo:400:kworker.0 00000100:00100000:3.0:1789181454.334595:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181454.334614:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfa62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876092510064640:0@lo:400:kworker.0 00000100:00100000:0.0:1789181454.334661:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181454.334700:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510064640 00000100:00100000:3.0:1789181454.334712:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510064640 00000100:00100000:1.0:1789181454.334735:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510064512 00000100:00100000:1.0:1789181454.334741:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510064512 00000100:00100000:3.0:1789181454.334772:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789181454.334781:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1789181454.334785:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876092510064640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181454.334794:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c373c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:3306:x1876092510064512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181454.334846:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c373c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:3306:x1876092510064512:12345-0@lo:400:kworker.0 Request processed in 56us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181454.334853:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1789181454.334993:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876092510064640:12345-0@lo:400:kworker.0 Request processed in 212us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181454.335002:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789181454.335003:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfa62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876092510064640:0@lo:400:kworker.0 00000100:00100000:0.0:1789181454.335021:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789181454.335028:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfa60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1876092510064768:0@lo:400:kworker.0 00000100:00100000:3.0:1789181454.335041:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfa63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:880710ad-110c-42a4-a174-ab1b99a7ebeb:3306:1876092510064512:0@lo:400:kworker.0 00000100:00100000:0.0:1789181454.335057:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181454.335084:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510064768 00000100:00100000:3.0:1789181454.335097:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510064768 00000100:00080000:0.0:1789181454.335182:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789181454.335248:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfa63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510064896:0@lo:400:kworker.0 00000100:00100000:0.0:1789181454.335275:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181454.335421:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510064896 00000100:00100000:1.0:1789181454.335425:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510064896 00000100:00100000:1.0:1789181454.335454:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789181454.335460:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6af3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510064896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181454.335540:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789181454.335552:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876092510064768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181454.335601:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876092510064768:12345-0@lo:400:kworker.0 Request processed in 52us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181454.335607:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789181454.335642:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfa60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1876092510065024:0@lo:400:kworker.0 00000100:00100000:3.0:1789181454.335681:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181454.335711:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6af3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510064896:12345-0@lo:400:kworker.0 Request processed in 250us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181454.335719:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789181454.335744:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfa62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876092510065152:0@lo:400:kworker.0 00000100:00100000:1.0:1789181454.335766:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181454.335797:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfa60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1876092510064768:0@lo:400:kworker.0 00000100:00100000:3.0:1789181454.336036:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510065152 00000100:00100000:3.0:1789181454.336041:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510065152 00000100:00100000:3.0:1789181454.336074:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789181454.336083:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b66dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1876092510065152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181454.336127:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b66dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1876092510065152:12345-0@lo:400:kworker.0 Request processed in 46us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181454.336133:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:3.0:1789181454.336242:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc1bfa62d80 x1876092510065152/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181470 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181454.336554:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfa62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876092510065152:0@lo:400:kworker.0 00000100:00100000:2.0:1789181454.337013:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510065024 00000100:00100000:2.0:1789181454.337020:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510065024 00000100:00100000:2.0:1789181454.337056:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789181454.337065:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfa2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876092510065024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181454.337112:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfa2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876092510065024:12345-0@lo:400:kworker.0 Request processed in 49us (1442us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181454.337119:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789181454.337151:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfa60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1876092510065024:0@lo:400:kworker.0 00010000:00080000:0.0:1789181454.337226:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc1bfa63800 x1876092510064896/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181470 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181454.337237:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfa63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510064896:0@lo:400:kworker.0 00000100:00080000:0.0:1789181454.337257:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789181454.337261:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789181454.337263:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789181454.846875:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789181454.846915:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc18854a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876092510065280:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789181454.847246:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181454.847467:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510065280 00000100:00100000:0.0:1789181454.847475:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510065280 00000100:00100000:0.0:1789181454.847541:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789181454.847550:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc188549880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876092510065280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789181454.847583:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789181454.847629:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc188549880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876092510065280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181454.847643:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:1.0:1789181454.847741:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc18854a300 x1876092510065280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181470 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181454.847760:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc18854a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876092510065280:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789181454.913204:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181455.934554:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789181456.223744:0:11375:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg432-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789181456.958937:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789181457.406905:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789181457.406929:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfa60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876092510065408:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789181457.407000:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181457.407220:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510065408 00000100:00100000:1.0:1789181457.407229:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510065408 00000100:00100000:1.0:1789181457.407296:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789181457.407308:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfa2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876092510065408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789181457.407366:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789181457.407422:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfa2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876092510065408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181457.407428:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:1.0:1789181457.407466:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc1bfa60a80 x1876092510065408/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181473 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181457.407485:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfa60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876092510065408:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789181457.407599:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789181457.983699:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181458.518008:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181458.518049:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181458.518073:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181458.518553:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488007680 00000100:00100000:3.0:1789181458.518564:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488007680 00000100:00100000:3.0:1789181458.518635:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488007808 00000100:00100000:3.0:1789181458.518638:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488007808 00000100:00100000:3.0:1789181458.518663:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 98 00000100:00100000:3.0:1789181458.518673:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6af3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+6:2354:x1876092488007680:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:3.0:1789181458.518742:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6af3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+6:2354:x1876092488007680:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 70us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181458.518750:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 98 00000100:00100000:3.0:1789181458.518779:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 99 00000100:00100000:3.0:1789181458.518786:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6af0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7badad21-a177-49b1-a2af-7b11e28c02ce+5:2354:x1876092488007808:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:3.0:1789181458.518810:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6af0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7badad21-a177-49b1-a2af-7b11e28c02ce+5:2354:x1876092488007808:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 25us (736us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181458.518816:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 99 00000100:00100000:3.0:1789181458.518845:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488007552 00000100:00100000:3.0:1789181458.518849:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488007552 00000100:00100000:3.0:1789181458.518886:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 247 00000100:00100000:3.0:1789181458.518893:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c373850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:975a0591-a8f7-4a74-9f93-a5aa77f2315c+13:2354:x1876092488007552:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:3.0:1789181458.518918:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c373850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:975a0591-a8f7-4a74-9f93-a5aa77f2315c+13:2354:x1876092488007552:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 26us (869us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181458.518925:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 247 00000100:00080000:0.0:1789181458.520898:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789181459.007230:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181459.456561:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfa61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:880710ad-110c-42a4-a174-ab1b99a7ebeb:3306:1876092510065536:0@lo:400:kworker.0 00000100:00100000:1.0:1789181459.456639:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181459.456703:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfa61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1876092510066048:0@lo:400:kworker.0 00000100:00100000:1.0:1789181459.456732:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181459.456763:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789181459.456769:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfa61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876092510065920:0@lo:400:kworker.0 00000100:00100000:1.0:1789181459.456813:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181459.456850:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510066048 00000100:00100000:1.0:1789181459.456872:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510066048 00000100:00100000:1.0:1789181459.456927:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789181459.456937:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc18854a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876092510066048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181459.456987:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc18854a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876092510066048:12345-0@lo:400:kworker.0 Request processed in 52us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181459.456994:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789181459.457017:0:6894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510065920 00000100:00100000:1.0:1789181459.457021:0:6894:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510065920 00000100:00100000:1.0:1789181459.457046:0:6894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789181459.457053:0:6894:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1876092510065920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181459.457081:0:6894:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1876092510065920:12345-0@lo:400:kworker.0 Request processed in 29us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181459.457086:0:6894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:1.0:1789181459.457125:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc1bfa61f80 x1876092510065920/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181475 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181459.457139:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfa61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876092510065920:0@lo:400:kworker.0 00000100:00100000:1.0:1789181459.457150:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfa61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1876092510066048:0@lo:400:kworker.0 00000100:00100000:3.0:1789181459.457722:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfa63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876092510065664:0@lo:400:kworker.0 00000100:00100000:3.0:1789181459.457773:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181459.457825:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfa61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876092510066176:0@lo:400:kworker.0 00000100:00100000:3.0:1789181459.457850:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181459.457885:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789181459.457892:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfa60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1876092510065792:0@lo:400:kworker.0 00000100:00100000:3.0:1789181459.457922:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181459.457949:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510066176 00000100:00100000:3.0:1789181459.457954:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510066176 00000100:00100000:3.0:1789181459.457991:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00080000:0.0:1789181459.458005:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789181459.458007:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1876092510066176:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789181459.458024:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789181459.458028:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789181459.458059:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1876092510066176:12345-0@lo:400:kworker.0 Request processed in 60us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181459.458066:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789181459.458086:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510065664 00000100:00100000:3.0:1789181459.458089:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510065664 00000100:00100000:3.0:1789181459.458109:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510065792 00000100:00100000:3.0:1789181459.458112:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510065792 00000100:00100000:3.0:1789181459.458136:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00080000:0.0:1789181459.458139:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789181459.458144:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876092510065664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181459.458175:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876092510065664:12345-0@lo:400:kworker.0 Request processed in 33us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181459.458181:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789181459.458192:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789181459.458198:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876092510065792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181459.458224:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876092510065792:12345-0@lo:400:kworker.0 Request processed in 27us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181459.458229:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789181459.458255:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfa60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1876092510065792:0@lo:400:kworker.0 00000100:00100000:3.0:1789181459.458265:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfa63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876092510065664:0@lo:400:kworker.0 00010000:00080000:3.0:1789181459.458275:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc1bfa61180 x1876092510066176/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181475 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181459.458297:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfa61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876092510066176:0@lo:400:kworker.0 00000100:00100000:2.0:1789181459.459898:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510065536 00000100:00100000:2.0:1789181459.459909:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510065536 00000100:00100000:2.0:1789181459.459954:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1789181459.459964:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c373050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:3306:x1876092510065536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181459.460078:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c373050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:3306:x1876092510065536:12345-0@lo:400:kworker.0 Request processed in 116us (3438us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181459.460085:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1789181459.460542:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfa61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:880710ad-110c-42a4-a174-ab1b99a7ebeb:3306:1876092510065536:0@lo:400:kworker.0 00000100:00100000:0.0:1789181459.966671:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1825a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876092510066304:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789181459.966741:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181459.966997:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510066304 00000100:00100000:1.0:1789181459.967005:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510066304 00000100:00100000:1.0:1789181459.967064:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789181459.967073:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6af2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876092510066304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789181459.967107:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789181459.967285:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6af2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876092510066304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 213us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181459.967294:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:0.0:1789181459.967593:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc1825a2a00 x1876092510066304/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181475 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181459.967613:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1825a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876092510066304:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789181460.033592:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789181460.134092:0:11475:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 22:50:59 (1789181459) === 00000100:00100000:2.0:1789181460.369587:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181460.369896:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181460.370104:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488008064 00000100:00100000:0.0:1789181460.370116:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488008064 00000100:00100000:0.0:1789181460.370197:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 0 00000100:00100000:0.0:1789181460.370210:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfa61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:5971a429-48ca-4c07-88a3-fa58102a53bc+6:9681:x1876092488008064:12345-192.168.204.32@tcp:700:mkdir.0 00000100:00100000:0.0:1789181460.370301:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfa61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:5971a429-48ca-4c07-88a3-fa58102a53bc+6:9681:x1876092488008064:12345-192.168.204.32@tcp:700:mkdir.0 Request processed in 94us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181460.370308:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 0 00000100:00080000:1.0:1789181460.370446:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789181460.371226:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488007936 00000100:00100000:3.0:1789181460.371232:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488007936 00000100:00100000:3.0:1789181460.371359:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 14 00000100:00100000:3.0:1789181460.371370:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfa61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+6:2354:x1876092488007936:12345-192.168.204.32@tcp:41:mkdir.0 00000004:00000024:3.0:1789181460.371412:0:5843:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789181460.371485:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfa61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+6:2354:x1876092488007936:12345-192.168.204.32@tcp:41:mkdir.0 Request processed in 117us (1589us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181460.371497:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 14 00000100:00100000:3.0:1789181460.391456:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181460.391667:0:6887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488008320 00000100:00100000:1.0:1789181460.391677:0:6887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488008320 00000100:00100000:2.0:1789181460.391859:0:6887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 15 00000100:00100000:2.0:1789181460.391871:0:6887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+6:9681:x1876092488008320:12345-192.168.204.32@tcp:36:mkdir.0 00010000:00010000:2.0:1789181460.391937:0:6887:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789181460.392008:0:6887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f600/0x8f4f7840b2e41138 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91ef5a expref: 6 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.392030:0:6887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc192187800) 00010000:00010000:2.0:1789181460.392058:0:6887:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789181460.392618:0:6887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784a00/0x8f4f7840b2e41257 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.392633:0:6887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784a00/0x8f4f7840b2e41257 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.392641:0:6887:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784a00/0x8f4f7840b2e41257 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.392671:0:6887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e4125e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.392679:0:6887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e4125e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.392687:0:6887:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e4125e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789181460.396224:0:6887:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789181460.396240:0:6887:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784a00/0x8f4f7840b2e41257 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.396250:0:6887:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784a00/0x8f4f7840b2e41257 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.396258:0:6887:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784a00/0x8f4f7840b2e41257 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.396264:0:6887:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1ba784a00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:2.0:1789181460.396269:0:6887:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784a00/0x8f4f7840b2e41257 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.396277:0:6887:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784a00/0x8f4f7840b2e41257 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.396291:0:6887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc1995b7b00) 00010000:00010000:2.0:1789181460.396294:0:6887:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789181460.396299:0:6887:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784a00/0x8f4f7840b2e41257 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.396304:0:6887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784a00/0x8f4f7840b2e41257 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789181460.396327:0:6887:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a07d277c reply state 00000000e14fe256 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e4125e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181460.396456:0:6887:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789181460.396627:0:6887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+7:9681:x1876092488008320:12345-192.168.204.32@tcp:36:mkdir.0 Request processed in 4753us (5179us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1789181460.396646:0:6887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 15 00010000:00010000:3.0:1789181460.399837:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e4125e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.399855:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e4125e lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.399864:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e4125e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.399870:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1ba785c00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:3.0:1789181460.399874:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e4125e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.399882:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e4125e lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.399907:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9dc1995b7f00) 00010000:00010000:3.0:1789181460.400027:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181460.400033:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e4125e lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.400040:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e4125e lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181460.416475:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181460.417598:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488008448 00000100:00100000:1.0:1789181460.417609:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488008448 00000100:00100000:2.0:1789181460.417806:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 16 00000100:00100000:2.0:1789181460.417818:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfa63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+6:9682:x1876092488008448:12345-192.168.204.32@tcp:101:chmod.0 00010000:00010000:2.0:1789181460.417849:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181460.417880:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784a00/0x8f4f7840b2e41265 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91efdf expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.418061:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784200/0x8f4f7840b2e4126c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.418075:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784200/0x8f4f7840b2e4126c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.418087:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784200/0x8f4f7840b2e4126c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789181460.418134:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789181460.418138:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789181460.418176:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784200/0x8f4f7840b2e4126c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.418323:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784a00/0x8f4f7840b2e41265 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91efdf expref: 8 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.418468:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784200/0x8f4f7840b2e4126c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91efdf expref: 7 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.418496:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc1995b7b00) 00010000:00010000:2.0:1789181460.418499:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789181460.418503:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1ba784200, rc 0) 00000100:00100000:2.0:1789181460.418610:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfa63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+7:9682:x1876092488008448:12345-192.168.204.32@tcp:101:chmod.0 Request processed in 795us (2144us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181460.418618:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 16 00000100:00100000:2.0:1789181460.422662:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181460.422746:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488008704 00000100:00100000:1.0:1789181460.422755:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488008704 00000100:00100000:1.0:1789181460.422831:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 17 00000100:00100000:1.0:1789181460.422840:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfa60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+7:9682:x1876092488008704:12345-192.168.204.32@tcp:36:chmod.0 00010000:00010000:1.0:1789181460.422899:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789181460.423115:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784200/0x8f4f7840b2e4126c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91efdf expref: 7 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181460.423138:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc1995b7b00) 00010000:00010000:1.0:1789181460.423148:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789181460.423174:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c2045600/0x8f4f7840b2e41273 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181460.423197:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c2045600/0x8f4f7840b2e41273 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181460.423207:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c2045600/0x8f4f7840b2e41273 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789181460.423545:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005a135e4a reply state 000000009afdba91 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c2045600/0x8f4f7840b2e41273 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181460.423555:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789181460.423562:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1789181460.423634:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfa60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+8:9682:x1876092488008704:12345-192.168.204.32@tcp:36:chmod.0 Request processed in 795us (982us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1789181460.423640:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 17 00010000:00010000:1.0:1789181460.426618:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c2045600/0x8f4f7840b2e41273 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181460.426635:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c2045600/0x8f4f7840b2e41273 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181460.426644:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c2045600/0x8f4f7840b2e41273 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181460.426650:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1c2045600 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:1.0:1789181460.426654:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c2045600/0x8f4f7840b2e41273 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181460.426662:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c2045600/0x8f4f7840b2e41273 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181460.426678:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc18a6c2500) 00010000:00010000:1.0:1789181460.426682:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789181460.426686:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c2045600/0x8f4f7840b2e41273 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181460.426693:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c2045600/0x8f4f7840b2e41273 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181460.459130:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181460.459450:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488008832 00000100:00100000:3.0:1789181460.459463:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488008832 00000100:00100000:3.0:1789181460.459531:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 18 00000100:00100000:3.0:1789181460.459542:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfa61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+7:9683:x1876092488008832:12345-192.168.204.32@tcp:101:chown.0 00010000:00010000:3.0:1789181460.459570:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181460.459594:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e4127a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91efe6 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.459661:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e800/0x8f4f7840b2e41281 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.459675:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e800/0x8f4f7840b2e41281 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.459688:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e800/0x8f4f7840b2e41281 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789181460.459721:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789181460.459725:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789181460.459767:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e800/0x8f4f7840b2e41281 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.459808:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e4127a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91efe6 expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.459848:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e800/0x8f4f7840b2e41281 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91efe6 expref: 8 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.459856:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc192187200) 00010000:00010000:3.0:1789181460.459859:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789181460.459862:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1bfa1e800, rc 0) 00000100:00100000:3.0:1789181460.460047:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfa61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+8:9683:x1876092488008832:12345-192.168.204.32@tcp:101:chown.0 Request processed in 506us (938us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181460.460054:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 18 00000100:00100000:1.0:1789181460.465479:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181460.465595:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488008960 00000100:00100000:3.0:1789181460.465606:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488008960 00000100:00100000:3.0:1789181460.465706:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 19 00000100:00100000:3.0:1789181460.465720:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1825a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+8:9683:x1876092488008960:12345-192.168.204.32@tcp:101:chown.0 00010000:00010000:3.0:1789181460.465751:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181460.465810:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e41288 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91efed expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.465901:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e4128f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.466104:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e4128f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.466120:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e4128f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.466138:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e400/0x8f4f7840b2e41296 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.466168:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e400/0x8f4f7840b2e41296 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.466195:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e400/0x8f4f7840b2e41296 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.466297:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e600/0x8f4f7840b2e4129d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.466306:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e600/0x8f4f7840b2e4129d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.466314:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e600/0x8f4f7840b2e4129d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789181460.466381:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789181460.466386:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789181460.466406:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e600/0x8f4f7840b2e4129d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.466418:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e4128f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.466424:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e4128f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.466431:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e4128f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.466438:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1bfa1ee00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:3.0:1789181460.466442:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e4128f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.466456:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e4128f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.466475:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc192187200) 00010000:00010000:3.0:1789181460.466478:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181460.466484:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e4128f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.466490:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e4128f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.466504:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e400/0x8f4f7840b2e41296 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.466510:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e400/0x8f4f7840b2e41296 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.466516:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e400/0x8f4f7840b2e41296 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.466521:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1bfa1e400 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:3.0:1789181460.466523:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e400/0x8f4f7840b2e41296 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.466528:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e400/0x8f4f7840b2e41296 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.466535:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9dc192187400) 00010000:00010000:3.0:1789181460.466538:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181460.466541:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e400/0x8f4f7840b2e41296 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.466556:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e400/0x8f4f7840b2e41296 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.466589:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e41288 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91efed expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.466602:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e600/0x8f4f7840b2e4129d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91efed expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.466609:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9dc192187000) 00010000:00010000:3.0:1789181460.466612:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789181460.466614:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1bfa1e600, rc 0) 00000100:00100000:3.0:1789181460.466681:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1825a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+9:9683:x1876092488008960:12345-192.168.204.32@tcp:101:chown.0 Request processed in 965us (1213us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181460.466689:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 19 00000100:00100000:0.0:1789181460.470070:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181460.470133:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488009216 00000100:00100000:3.0:1789181460.470155:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488009216 00000100:00100000:3.0:1789181460.470219:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 20 00000100:00100000:3.0:1789181460.470230:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6af1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+9:9683:x1876092488009216:12345-192.168.204.32@tcp:36:chown.0 00010000:00010000:3.0:1789181460.470290:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789181460.470320:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e600/0x8f4f7840b2e4129d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91efed expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.470370:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9dc192187000) 00010000:00010000:3.0:1789181460.470381:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789181460.470409:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e412a4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.470433:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e412a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.470443:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e412a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789181460.513710:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000001:00080000:3.0:1789181460.513726:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:2.0:1789181460.513802:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009f7862ab reply state 00000000032229b2 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e412a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181460.513817:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789181460.513842:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00080000:2.0:1789181460.513950:0:5843:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1789181460.515069:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6af1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+7:9683:x1876092488009216:12345-192.168.204.32@tcp:36:chown.0 Request processed in 44834us (45001us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1789181460.515080:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 20 00010000:00010000:3.0:1789181460.515362:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e412a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.515374:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e412a4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.515383:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e412a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.515389:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1bfa1f400 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:3.0:1789181460.515394:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e412a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.515402:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e412a4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.515419:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9dc192187b00) 00010000:00010000:3.0:1789181460.515422:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789181460.515427:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e412a4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.515434:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e412a4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181460.529001:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181460.529365:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488009344 00000100:00100000:3.0:1789181460.529374:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488009344 00000100:00100000:3.0:1789181460.529430:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 21 00000100:00100000:3.0:1789181460.529440:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c026ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+6:9684:x1876092488009344:12345-192.168.204.32@tcp:101:touch.500 00010000:00010000:3.0:1789181460.529464:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181460.529483:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e412ab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91eff4 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789181460.531044:0:5844:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1515us 00010000:00010000:1.0:1789181460.544028:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c2045600/0x8f4f7840b2e412b2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181460.544051:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c2045600/0x8f4f7840b2e412b2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181460.544073:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c2045600/0x8f4f7840b2e412b2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181460.544099:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c2045e00/0x8f4f7840b2e412b9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181460.544107:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c2045e00/0x8f4f7840b2e412b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181460.544113:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c2045e00/0x8f4f7840b2e412b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181460.544418:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c2045c00/0x8f4f7840b2e412c0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181460.544427:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c2045c00/0x8f4f7840b2e412c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181460.544435:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c2045c00/0x8f4f7840b2e412c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789181460.544456:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789181460.544460:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789181460.544500:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c2045c00/0x8f4f7840b2e412c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181460.544512:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c2045600/0x8f4f7840b2e412b2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181460.544520:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c2045600/0x8f4f7840b2e412b2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181460.544527:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c2045600/0x8f4f7840b2e412b2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181460.544542:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1c2045600 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:1.0:1789181460.544547:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c2045600/0x8f4f7840b2e412b2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181460.544555:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c2045600/0x8f4f7840b2e412b2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181460.544567:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc192187200) 00010000:00010000:1.0:1789181460.544570:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789181460.544575:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c2045600/0x8f4f7840b2e412b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181460.544582:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c2045600/0x8f4f7840b2e412b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181460.544593:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c2045e00/0x8f4f7840b2e412b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181460.544599:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c2045e00/0x8f4f7840b2e412b9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181460.544606:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c2045e00/0x8f4f7840b2e412b9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181460.544612:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1c2045e00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:1.0:1789181460.544615:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c2045e00/0x8f4f7840b2e412b9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181460.544621:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c2045e00/0x8f4f7840b2e412b9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181460.544638:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9dc18a6c2500) 00010000:00010000:1.0:1789181460.544641:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789181460.544644:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c2045e00/0x8f4f7840b2e412b9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181460.544650:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c2045e00/0x8f4f7840b2e412b9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181460.544687:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e412ab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91eff4 expref: 8 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181460.544704:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c2045c00/0x8f4f7840b2e412c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91eff4 expref: 7 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181460.544712:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9dc18a6c2200) 00010000:00010000:1.0:1789181460.544715:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789181460.544718:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1c2045c00, rc 0) 00000100:00100000:1.0:1789181460.544798:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c026ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+7:9684:x1876092488009344:12345-192.168.204.32@tcp:101:touch.500 Request processed in 15358us (15804us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181460.544809:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 21 00000100:00100000:2.0:1789181460.547772:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181460.547850:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488009600 00000100:00100000:3.0:1789181460.547861:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488009600 00000100:00100000:3.0:1789181460.547930:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 22 00000100:00100000:3.0:1789181460.547941:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfa61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+7:9684:x1876092488009600:12345-192.168.204.32@tcp:101:touch.500 00010000:00010000:3.0:1789181460.547963:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181460.547982:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e600/0x8f4f7840b2e412c7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91effb expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.548289:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e412ce lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.548304:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e412ce lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.548317:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e412ce lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.548398:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e400/0x8f4f7840b2e412d5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.548419:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e400/0x8f4f7840b2e412d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.548427:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e400/0x8f4f7840b2e412d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789181460.549216:0:5842:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:3.0:1789181460.549543:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e412dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.549625:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e412dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.549635:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e412dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.549668:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e412ce lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.549675:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e412ce lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.549682:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e412ce lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.549688:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1bfa1f000 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:3.0:1789181460.549693:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e412ce lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.549700:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e412ce lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.549722:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9dc18a6c2200) 00010000:00010000:3.0:1789181460.549725:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181460.549731:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e412ce lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.549981:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e412ce lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789181460.549998:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e75dbd09 reply state 00000000943f1014 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e400/0x8f4f7840b2e412d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181460.550007:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789181460.550041:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e600/0x8f4f7840b2e412c7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91effb expref: 10 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.550056:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e412dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91effb expref: 9 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.550064:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9dc192187000) 00010000:00010000:3.0:1789181460.550066:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789181460.550068:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1bfa1ee00, rc 0) 00000100:00100000:3.0:1789181460.550216:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfa61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+10:9684:x1876092488009600:12345-192.168.204.32@tcp:101:touch.500 Request processed in 2275us (2466us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1789181460.550225:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 22 00010000:00010000:3.0:1789181460.552698:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e400/0x8f4f7840b2e412d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.552716:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e400/0x8f4f7840b2e412d5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.552738:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e400/0x8f4f7840b2e412d5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.552744:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1bfa1e400 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:3.0:1789181460.552753:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e400/0x8f4f7840b2e412d5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.552764:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e400/0x8f4f7840b2e412d5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.552780:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x369fa11a (ffff9dc192187b00) 00010000:00010000:3.0:1789181460.552794:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181460.552799:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e400/0x8f4f7840b2e412d5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.552806:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e400/0x8f4f7840b2e412d5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181460.555661:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181460.555753:0:6887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488009856 00000100:00100000:1.0:1789181460.555762:0:6887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488009856 00000100:00100000:1.0:1789181460.555866:0:6887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 23 00000100:00100000:1.0:1789181460.555877:0:6887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfa60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+9:9684:x1876092488009856:12345-192.168.204.32@tcp:36:touch.500 00010000:00010000:1.0:1789181460.555929:0:6887:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789181460.555951:0:6887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e412dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91effb expref: 9 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181460.555987:0:6887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9dc192187000) 00010000:00010000:1.0:1789181460.555999:0:6887:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789181460.556040:0:6887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c2045e00/0x8f4f7840b2e412ea lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181460.556053:0:6887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c2045e00/0x8f4f7840b2e412ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181460.556063:0:6887:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c2045e00/0x8f4f7840b2e412ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789181460.556207:0:6887:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009dd7de46 reply state 00000000dc5b8057 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c2045e00/0x8f4f7840b2e412ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181460.556217:0:6887:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789181460.556366:0:6887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfa60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+10:9684:x1876092488009856:12345-192.168.204.32@tcp:36:touch.500 Request processed in 455us (826us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1789181460.556381:0:6887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 23 00000100:00100000:2.0:1789181460.559876:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181460.560021:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488009984 00000100:00100000:3.0:1789181460.560030:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488009984 00000100:00100000:3.0:1789181460.560087:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 24 00000100:00100000:3.0:1789181460.560098:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfa63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+10:9684:x1876092488009984:12345-192.168.204.32@tcp:101:touch.500 00010000:00010000:3.0:1789181460.560121:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181460.560143:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e600/0x8f4f7840b2e412f1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f002 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.560199:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e600/0x8f4f7840b2e412f1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f002 expref: 11 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.560237:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e600/0x8f4f7840b2e412f1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f002 expref: 11 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.560259:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9dc18a6c2500) 00010000:00010000:3.0:1789181460.560262:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789181460.560266:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1bfa1e600, rc 0) 00000100:00100000:3.0:1789181460.560325:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfa63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+11:9684:x1876092488009984:12345-192.168.204.32@tcp:101:touch.500 Request processed in 229us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181460.560355:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 24 00010000:00010000:1.0:1789181460.562625:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c2045e00/0x8f4f7840b2e412ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181460.562641:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c2045e00/0x8f4f7840b2e412ea lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181460.562650:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c2045e00/0x8f4f7840b2e412ea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181460.562657:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1c2045e00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:1.0:1789181460.562662:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c2045e00/0x8f4f7840b2e412ea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181460.562683:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c2045e00/0x8f4f7840b2e412ea lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181460.562698:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9dc18a6c2500) 00010000:00010000:1.0:1789181460.562702:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789181460.562707:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c2045e00/0x8f4f7840b2e412ea lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181460.562713:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c2045e00/0x8f4f7840b2e412ea lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181460.563557:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181460.563775:0:6894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488010112 00000100:00100000:1.0:1789181460.564479:0:6894:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488010112 00000100:00100000:1.0:1789181460.564573:0:6894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 16 00000100:00100000:1.0:1789181460.564582:0:6894:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c026df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2350:x1876092488010112:12345-192.168.204.32@tcp:8:touch.500 00010000:00080000:1.0:1789181460.564613:0:6894:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 5971a429-48ca-4c07-88a3-fa58102a53bc@192.168.204.32@tcp t0 exp 0000000000000000 cur 352 last 0 00000020:00000080:1.0:1789181460.564647:0:6894:0:(genops.c:1384:class_connect()) connect: client 5971a429-48ca-4c07-88a3-fa58102a53bc, cookie 0x8f4f7840b2e412f8 00002000:00100000:1.0:1789181460.564663:0:6894:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 5971a429-48ca-4c07-88a3-fa58102a53bc/ffff9dc1a7381000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789181460.564673:0:6894:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789181460.564964:0:6894:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789181460.565000:0:6894:0:(import.c:65:import_set_state_nolock()) ffff9dc1a7384000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789181460.565081:0:6894:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c026df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+6:2350:x1876092488010112:12345-192.168.204.32@tcp:8:touch.500 Request processed in 499us (1529us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181460.565089:0:6894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 16 00000100:00100000:0.0:1789181460.567175:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181460.567273:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488010240 00000100:00100000:2.0:1789181460.567280:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488010240 00000100:00080000:1.0:1789181460.567387:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789181460.567432:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 17 00000100:00100000:2.0:1789181460.567442:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c026dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+6:0:x1876092488010240:12345-192.168.204.32@tcp:2:touch.500 00000001:00100000:1.0:1789181460.592479:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5971a429-48ca-4c07-88a3-fa58102a53bc 00000001:00080000:1.0:1789181460.592497:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:2.0:1789181460.592714:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c026dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+5:0:x1876092488010240:12345-192.168.204.32@tcp:2:touch.500 Request processed in 25267us (25538us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1789181460.592733:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 17 00000100:00100000:0.0:1789181460.595745:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181460.595948:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488010496 00000100:00100000:1.0:1789181460.595958:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488010496 00000100:00100000:1.0:1789181460.596015:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2 00000100:00100000:1.0:1789181460.596025:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c026c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+10:9684:x1876092488010496:12345-192.168.204.32@tcp:35:touch.500 00000100:00100000:1.0:1789181460.596384:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c026c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+11:9684:x1876092488010496:12345-192.168.204.32@tcp:35:touch.500 Request processed in 360us (647us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1789181460.596392:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2 00000100:00100000:1.0:1789181460.610889:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181460.611289:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488010624 00000100:00100000:2.0:1789181460.611311:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488010624 00000100:00100000:2.0:1789181460.611414:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 25 00000100:00100000:2.0:1789181460.611426:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1825a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+11:9685:x1876092488010624:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:2.0:1789181460.611450:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181460.611471:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785a00/0x8f4f7840b2e412ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f009 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.611793:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785200/0x8f4f7840b2e41306 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.611808:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785200/0x8f4f7840b2e41306 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.612247:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785200/0x8f4f7840b2e41306 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789181460.612428:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789181460.612433:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789181460.612486:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785200/0x8f4f7840b2e41306 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.612602:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785a00/0x8f4f7840b2e412ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f009 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.612630:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785200/0x8f4f7840b2e41306 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f009 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.612639:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9dc18a6c2200) 00010000:00010000:3.0:1789181460.612641:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789181460.612645:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1ba785200, rc 0) 00000100:00100000:3.0:1789181460.612862:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1825a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+12:9685:x1876092488010624:12345-192.168.204.32@tcp:101:rm.0 Request processed in 1438us (1982us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181460.612870:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 25 00000100:00100000:0.0:1789181460.624820:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181460.624906:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488010880 00000100:00100000:3.0:1789181460.624917:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488010880 00000100:00100000:3.0:1789181460.624995:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 26 00000100:00100000:3.0:1789181460.625012:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c026c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+12:9685:x1876092488010880:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:3.0:1789181460.625030:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181460.625056:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e400/0x8f4f7840b2e4130d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f010 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789181460.625153:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1789181460.625610:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e400/0x8f4f7840b2e4130d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f010 expref: 14 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.625626:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc192187200) 00010000:00010000:3.0:1789181460.625629:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789181460.625634:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e400/0x8f4f7840b2e4130d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f010 expref: 14 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.625648:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1bfa1e400, rc 0) 00000100:00100000:3.0:1789181460.625841:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c026c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+13:9685:x1876092488010880:12345-192.168.204.32@tcp:101:rm.0 Request processed in 836us (1030us total) trans 4294967303 rc 301/301 00000100:00100000:3.0:1789181460.625848:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 26 00000100:00100000:0.0:1789181460.632611:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181460.632967:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488011008 00000100:00100000:1.0:1789181460.632985:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488011008 00000100:00100000:1.0:1789181460.633089:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 3 00000100:00100000:1.0:1789181460.633100:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c026e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+13:9685:x1876092488011008:12345-192.168.204.32@tcp:37:rm.0 00000100:00100000:2.0:1789181460.638203:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c026e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+13:9685:x1876092488011008:12345-192.168.204.32@tcp:37:rm.0 Request processed in 5095us (5597us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181460.638216:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 3 00000100:00100000:0.0:1789181460.641639:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181460.641715:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488011264 00000100:00100000:1.0:1789181460.641725:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488011264 00000100:00100000:1.0:1789181460.641795:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 4 00000100:00100000:1.0:1789181460.641806:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19928d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+13:9685:x1876092488011264:12345-192.168.204.32@tcp:35:rm.0 00000100:00100000:1.0:1789181460.642040:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19928d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+14:9685:x1876092488011264:12345-192.168.204.32@tcp:35:rm.0 Request processed in 235us (408us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1789181460.642048:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 4 00000100:00100000:1.0:1789181460.644145:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181460.644224:0:6887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488011520 00000100:00100000:2.0:1789181460.644232:0:6887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488011520 00000100:00100000:2.0:1789181460.644275:0:6887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 27 00000100:00100000:2.0:1789181460.644284:0:6887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1825a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+14:9685:x1876092488011520:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:2.0:1789181460.644304:0:6887:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181460.644322:0:6887:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785600/0x8f4f7840b2e4131b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f017 expref: -99 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.644510:0:6887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785a00/0x8f4f7840b2e41322 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.644524:0:6887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785a00/0x8f4f7840b2e41322 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.644549:0:6887:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785a00/0x8f4f7840b2e41322 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789181460.644560:0:6887:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789181460.644709:0:6887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785600/0x8f4f7840b2e4131b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f017 expref: 17 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.644731:0:6887:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785a00/0x8f4f7840b2e41322 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f017 expref: 16 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.644751:0:6887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9dc18a6c2200) 00010000:00010000:2.0:1789181460.644754:0:6887:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789181460.644758:0:6887:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1ba785a00, rc 0) 00000100:00100000:2.0:1789181460.644819:0:6887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1825a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+16:9685:x1876092488011520:12345-192.168.204.32@tcp:101:rm.0 Request processed in 536us (682us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1789181460.644827:0:6887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 27 00000100:00100000:0.0:1789181460.646839:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181460.646977:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488011648 00000100:00100000:3.0:1789181460.646986:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488011648 00000100:00100000:2.0:1789181460.650938:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 28 00000100:00100000:2.0:1789181460.650965:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c026c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+16:9685:x1876092488011648:12345-192.168.204.32@tcp:41:rm.0 00000004:00000024:2.0:1789181460.651032:0:5842:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:2.0:1789181460.651117:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c026c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+16:9685:x1876092488011648:12345-192.168.204.32@tcp:41:rm.0 Request processed in 165us (4284us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181460.651141:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 28 00000100:00100000:0.0:1789181460.656549:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181460.656635:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488011776 00000100:00100000:3.0:1789181460.656643:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488011776 00000100:00100000:3.0:1789181460.656683:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 29 00000100:00100000:3.0:1789181460.656695:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c026e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+16:9685:x1876092488011776:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:3.0:1789181460.656713:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181460.656739:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e400/0x8f4f7840b2e41330 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f01e expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.656802:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e41337 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.656944:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e41337 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.656963:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e41337 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.656982:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ec00/0x8f4f7840b2e4133e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x369fa11a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.656990:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ec00/0x8f4f7840b2e4133e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.656996:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ec00/0x8f4f7840b2e4133e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.657093:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e41345 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.657101:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e41345 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.657108:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e41345 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789181460.657134:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:3.0:1789181460.657138:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789181460.657155:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e41345 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.657172:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e41345 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.657180:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e41337 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.657187:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e41337 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.657194:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e41337 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.657200:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1bfa1f000 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:3.0:1789181460.657203:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e41337 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.657210:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e41337 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.657221:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9dc18a6c2200) 00010000:00010000:3.0:1789181460.657224:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181460.657228:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e41337 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.657234:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e41337 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.657246:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ec00/0x8f4f7840b2e4133e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.657253:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ec00/0x8f4f7840b2e4133e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.657262:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ec00/0x8f4f7840b2e4133e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.657267:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1bfa1ec00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:3.0:1789181460.657270:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ec00/0x8f4f7840b2e4133e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.657276:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ec00/0x8f4f7840b2e4133e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.657283:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x369fa11a (ffff9dc192187b00) 00010000:00010000:3.0:1789181460.657285:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181460.657287:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ec00/0x8f4f7840b2e4133e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.657293:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ec00/0x8f4f7840b2e4133e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.657320:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e400/0x8f4f7840b2e41330 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f01e expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.657464:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e41345 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f01e expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.657472:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9dc18a6c2500) 00010000:00010000:3.0:1789181460.657474:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789181460.657476:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1bfa1ee00, rc 0) 00000100:00100000:2.0:1789181460.657602:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c026e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+17:9685:x1876092488011776:12345-192.168.204.32@tcp:101:rm.0 Request processed in 911us (1063us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181460.657609:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 29 00000100:00100000:1.0:1789181460.664859:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181460.665504:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488012032 00000100:00100000:2.0:1789181460.665516:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488012032 00000100:00100000:2.0:1789181460.665574:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 30 00000100:00100000:2.0:1789181460.665585:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1825a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+17:9685:x1876092488012032:12345-192.168.204.32@tcp:36:rm.0 00010000:00010000:2.0:1789181460.665638:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789181460.665665:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e41345 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f01e expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.665689:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e600/0x8f4f7840b2e412f1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f002 expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.665713:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9dc18a6c2500) 00010000:00010000:2.0:1789181460.665733:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785200/0x8f4f7840b2e41306 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f009 expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.665746:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9dc18a6c2200) 00010000:00010000:2.0:1789181460.665749:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789181460.665770:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785600/0x8f4f7840b2e4134c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.665793:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785600/0x8f4f7840b2e4134c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.665829:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785600/0x8f4f7840b2e4134c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.665847:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785800/0x8f4f7840b2e41353 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.665854:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785800/0x8f4f7840b2e41353 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.665861:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785800/0x8f4f7840b2e41353 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.665970:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784a00/0x8f4f7840b2e4135a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.665979:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784a00/0x8f4f7840b2e4135a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.665985:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784a00/0x8f4f7840b2e4135a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789181460.666738:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1789181460.666750:0:5842:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 352923418654ns, next at 353923415850ns, rc = 0 00010000:00010000:2.0:1789181460.666818:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784200/0x8f4f7840b2e41361 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.666828:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784200/0x8f4f7840b2e41361 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.666836:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784200/0x8f4f7840b2e41361 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.666854:0:5842:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784200/0x8f4f7840b2e41361 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.666861:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784200/0x8f4f7840b2e41361 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.666867:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784200/0x8f4f7840b2e41361 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.666895:0:5842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789181460.666912:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784a00/0x8f4f7840b2e4135a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.666919:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784a00/0x8f4f7840b2e4135a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.666925:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784a00/0x8f4f7840b2e4135a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.666931:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1ba784a00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:2.0:1789181460.666935:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784a00/0x8f4f7840b2e4135a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.666942:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784a00/0x8f4f7840b2e4135a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.666951:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9dc1995b7b00) 00010000:00010000:3.0:1789181460.666952:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789181460.666953:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789181460.666958:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784a00/0x8f4f7840b2e4135a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.666959:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784200/0x8f4f7840b2e41361 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.666971:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1ba784200 already unused, calling callback (ffffffffc152f9b0) 00010000:00010000:2.0:1789181460.666972:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784a00/0x8f4f7840b2e4135a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.666974:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784200/0x8f4f7840b2e41361 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.666980:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784200/0x8f4f7840b2e41361 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.666989:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9dc1995b7b00) 00010000:00010000:2.0:1789181460.666989:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785600/0x8f4f7840b2e4134c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.666991:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789181460.666995:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784200/0x8f4f7840b2e41361 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.666995:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785600/0x8f4f7840b2e4134c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.667001:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784200/0x8f4f7840b2e41361 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.667002:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785600/0x8f4f7840b2e4134c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.667006:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1ba785600 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:2.0:1789181460.667009:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785600/0x8f4f7840b2e4134c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.667013:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181460.667014:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181460.667014:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785600/0x8f4f7840b2e4134c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.667016:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181460.667021:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9dc18a6c2200) 00010000:00010000:2.0:1789181460.667023:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789181460.667025:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785600/0x8f4f7840b2e4134c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.667030:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785600/0x8f4f7840b2e4134c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789181460.667039:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000073e19cce reply state 000000009b139ebc transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785800/0x8f4f7840b2e41353 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181460.667048:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789181460.667142:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1825a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+16:9685:x1876092488012032:12345-192.168.204.32@tcp:36:rm.0 Request processed in 1557us (2295us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1789181460.667150:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 30 00010000:00010000:3.0:1789181460.670435:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785800/0x8f4f7840b2e41353 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.670452:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785800/0x8f4f7840b2e41353 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.670458:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785800/0x8f4f7840b2e41353 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.670464:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1ba785800 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:3.0:1789181460.670468:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785800/0x8f4f7840b2e41353 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.670486:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785800/0x8f4f7840b2e41353 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.670503:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x369fa11a (ffff9dc1995b7c00) 00010000:00010000:3.0:1789181460.670506:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181460.670511:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785800/0x8f4f7840b2e41353 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181460.670516:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785800/0x8f4f7840b2e41353 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181460.679100:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181460.682531:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488012288 00000100:00100000:0.0:1789181460.682545:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488012288 00000100:00100000:0.0:1789181460.682609:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 5 00000100:00100000:0.0:1789181460.682620:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1825a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+15:9685:x1876092488012288:12345-192.168.204.32@tcp:35:rm.0 00000100:00100000:0.0:1789181460.682866:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1825a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+16:9685:x1876092488012288:12345-192.168.204.32@tcp:35:rm.0 Request processed in 247us (3775us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1789181460.682873:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 5 00000100:00100000:0.0:1789181460.688419:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181460.688509:0:6887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488012544 00000100:00100000:2.0:1789181460.688518:0:6887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488012544 00000100:00100000:2.0:1789181460.688586:0:6887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 31 00000100:00100000:2.0:1789181460.688596:0:6887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c026aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+16:9685:x1876092488012544:12345-192.168.204.32@tcp:36:rm.0 00010000:00010000:2.0:1789181460.688651:0:6887:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789181460.688677:0:6887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785a00/0x8f4f7840b2e41322 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f017 expref: 16 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.688715:0:6887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c2045c00/0x8f4f7840b2e412c0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91eff4 expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.688726:0:6887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9dc18a6c2200) 00010000:00010000:2.0:1789181460.688743:0:6887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e800/0x8f4f7840b2e41281 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91efe6 expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.688753:0:6887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc192187200) 00010000:00010000:2.0:1789181460.688760:0:6887:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789181460.688793:0:6887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785600/0x8f4f7840b2e41368 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.688806:0:6887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785600/0x8f4f7840b2e41368 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.688815:0:6887:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785600/0x8f4f7840b2e41368 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.688846:0:6887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784a00/0x8f4f7840b2e4136f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.688853:0:6887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784a00/0x8f4f7840b2e4136f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.688861:0:6887:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784a00/0x8f4f7840b2e4136f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.689115:0:6887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785200/0x8f4f7840b2e41376 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.689124:0:6887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785200/0x8f4f7840b2e41376 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.689132:0:6887:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785200/0x8f4f7840b2e41376 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789181460.689710:0:6887:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789181460.689726:0:6887:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785200/0x8f4f7840b2e41376 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.689733:0:6887:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785200/0x8f4f7840b2e41376 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.689741:0:6887:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785200/0x8f4f7840b2e41376 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.689746:0:6887:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1ba785200 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:2.0:1789181460.689750:0:6887:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785200/0x8f4f7840b2e41376 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.689768:0:6887:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785200/0x8f4f7840b2e41376 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.689777:0:6887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9dc1995b7000) 00010000:00010000:2.0:1789181460.689789:0:6887:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789181460.689794:0:6887:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785200/0x8f4f7840b2e41376 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.689800:0:6887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785200/0x8f4f7840b2e41376 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.689819:0:6887:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785600/0x8f4f7840b2e41368 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.689825:0:6887:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785600/0x8f4f7840b2e41368 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.689831:0:6887:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785600/0x8f4f7840b2e41368 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.689835:0:6887:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1ba785600 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:2.0:1789181460.689838:0:6887:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785600/0x8f4f7840b2e41368 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.689843:0:6887:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785600/0x8f4f7840b2e41368 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.689851:0:6887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc1995b7f00) 00010000:00010000:2.0:1789181460.689853:0:6887:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789181460.689856:0:6887:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785600/0x8f4f7840b2e41368 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181460.689871:0:6887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785600/0x8f4f7840b2e41368 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789181460.689886:0:6887:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000028fe3e7e reply state 000000005809afa2 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784a00/0x8f4f7840b2e4136f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181460.689893:0:6887:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789181460.689959:0:6887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c026aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+15:9685:x1876092488012544:12345-192.168.204.32@tcp:36:rm.0 Request processed in 1363us (1547us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1789181460.689966:0:6887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 31 00010000:00010000:1.0:1789181460.693645:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784a00/0x8f4f7840b2e4136f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181460.693674:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784a00/0x8f4f7840b2e4136f lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181460.693696:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784a00/0x8f4f7840b2e4136f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181460.693702:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1ba784a00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:1.0:1789181460.693707:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784a00/0x8f4f7840b2e4136f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181460.693715:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784a00/0x8f4f7840b2e4136f lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181460.693731:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9dc1995b7900) 00010000:00010000:1.0:1789181460.693734:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789181460.693738:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784a00/0x8f4f7840b2e4136f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181460.693744:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784a00/0x8f4f7840b2e4136f lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181461.054589:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181462.078478:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181462.528195:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789181462.528219:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfa62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876092510066432:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789181462.528285:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181462.529957:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510066432 00000100:00100000:2.0:1789181462.529975:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510066432 00000100:00100000:2.0:1789181462.536538:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789181462.536558:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1825a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876092510066432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789181462.536603:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789181462.536697:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1825a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876092510066432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 147us (8411us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181462.536704:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:2.0:1789181462.536776:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc1bfa62d80 x1876092510066432/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181478 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181462.536803:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfa62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876092510066432:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789181462.538773:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789181463.105277:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789181463.650895:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181463.651945:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181463.651976:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181463.652004:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181463.652038:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488012800 00000100:00100000:3.0:1789181463.652048:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488012800 00000100:00100000:1.0:1789181463.652086:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488012672 00000100:00100000:1.0:1789181463.652094:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488012672 00000100:00100000:3.0:1789181463.652117:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488013056 00000100:00100000:3.0:1789181463.652122:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488013056 00000100:00100000:1.0:1789181463.652138:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 249 00000100:00100000:1.0:1789181463.652150:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c370850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:975a0591-a8f7-4a74-9f93-a5aa77f2315c+13:2353:x1876092488012672:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:3.0:1789181463.652158:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 103 00000100:00100000:3.0:1789181463.652183:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+14:2353:x1876092488012800:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:1.0:1789181463.652220:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c370850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:975a0591-a8f7-4a74-9f93-a5aa77f2315c+13:2353:x1876092488012672:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 72us (1337us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181463.652230:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+14:2353:x1876092488012800:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 62us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181463.652230:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 249 00000100:00100000:3.0:1789181463.652241:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 103 00000100:00100000:3.0:1789181463.652260:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 104 00000100:00100000:3.0:1789181463.652269:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7badad21-a177-49b1-a2af-7b11e28c02ce+5:2353:x1876092488013056:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:3.0:1789181463.652312:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7badad21-a177-49b1-a2af-7b11e28c02ce+5:2353:x1876092488013056:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 45us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181463.652319:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 104 00000100:00080000:3.0:1789181463.652362:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789181463.652522:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488012928 00000100:00100000:2.0:1789181463.652527:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488012928 00000100:00100000:2.0:1789181463.652572:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 59 00000100:00100000:2.0:1789181463.652579:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+5:2353:x1876092488012928:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:2.0:1789181463.652611:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+5:2353:x1876092488012928:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 33us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181463.652623:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 59 00000100:00080000:0.0:1789181463.652668:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789181464.127479:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789181464.255726:0:11625:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000100:00100000:2.0:1789181464.574606:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfa62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:880710ad-110c-42a4-a174-ab1b99a7ebeb:3306:1876092510066560:0@lo:400:kworker.0 00000100:00100000:2.0:1789181464.574691:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181464.574857:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfa62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510066944:0@lo:400:kworker.0 00000100:00100000:3.0:1789181464.574889:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181464.574959:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfa63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1876092510066816:0@lo:400:kworker.0 00000100:00100000:1.0:1789181464.575000:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181464.575072:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfa62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1876092510067072:0@lo:400:kworker.0 00000100:00100000:2.0:1789181464.575106:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181464.575163:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510066560 00000100:00100000:2.0:1789181464.575171:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510066560 00000100:00100000:2.0:1789181464.575224:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1789181464.575240:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c372050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:3306:x1876092510066560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181464.575316:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c372050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:3306:x1876092510066560:12345-0@lo:400:kworker.0 Request processed in 83us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181464.575323:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1789181464.575458:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfa60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876092510066688:0@lo:400:kworker.0 00000100:00100000:0.0:1789181464.575496:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181464.575534:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfa60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876092510067200:0@lo:400:kworker.0 00000100:00100000:0.0:1789181464.575565:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181464.581959:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510066944 00000100:00100000:3.0:1789181464.581976:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510066944 00000100:00100000:3.0:1789181464.582064:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510067200 00000100:00100000:3.0:1789181464.582067:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510067200 00000100:00100000:3.0:1789181464.582099:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789181464.582108:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510066944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181464.582212:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510066944:12345-0@lo:400:kworker.0 Request processed in 106us (7322us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181464.582219:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789181464.582245:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789181464.582251:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c026bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1876092510067200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181464.582540:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c026bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1876092510067200:12345-0@lo:400:kworker.0 Request processed in 288us (6973us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181464.582554:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:3.0:1789181464.582583:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789181464.582588:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789181464.582630:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc1bfa60000 x1876092510067200/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181480 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181464.582651:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfa60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876092510067200:0@lo:400:kworker.0 00010000:00080000:3.0:1789181464.583401:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc1bfa62300 x1876092510066944/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181480 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181464.583441:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfa62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510066944:0@lo:400:kworker.0 00000100:00100000:3.0:1789181464.583493:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfa62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:880710ad-110c-42a4-a174-ab1b99a7ebeb:3306:1876092510066560:0@lo:400:kworker.0 00000100:00100000:3.0:1789181464.583547:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510066816 00000100:00100000:3.0:1789181464.583553:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510066816 00000100:00100000:3.0:1789181464.583608:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510067072 00000100:00100000:3.0:1789181464.583612:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510067072 00000100:00100000:3.0:1789181464.583629:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510066688 00000100:00100000:3.0:1789181464.583639:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510066688 00000100:00100000:3.0:1789181464.583654:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789181464.583661:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1825a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876092510066816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181464.583728:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1825a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876092510066816:12345-0@lo:400:kworker.0 Request processed in 67us (8727us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181464.583735:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789181464.583880:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789181464.583920:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfa63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1876092510066816:0@lo:400:kworker.0 00000100:00100000:0.0:1789181464.584032:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfa62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876092510067072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181464.585555:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789181464.585574:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c0268a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876092510066688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181464.585757:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfa62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1876092510067072:0@lo:400:kworker.0 00000100:00100000:3.0:1789181464.587450:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c0268a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876092510066688:12345-0@lo:400:kworker.0 Request processed in 1879us (11947us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181464.587462:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:3.0:1789181464.587501:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789181464.587641:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfa60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876092510066688:0@lo:400:kworker.0 00000100:00100000:0.0:1789181464.589901:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfa62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876092510067072:12345-0@lo:400:kworker.0 Request processed in 6004us (14784us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181464.589914:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000004:00080000:1.0:1789181465.094534:0:8013:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 357351198662ns, next at 358351195819ns, rc = 0 00000100:00100000:3.0:1789181465.094684:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1825a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876092510067328:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789181465.094773:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181465.095063:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510067328 00000100:00100000:1.0:1789181465.095071:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510067328 00000100:00100000:1.0:1789181465.095126:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789181465.095137:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876092510067328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789181465.095171:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789181465.095215:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876092510067328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181465.095222:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:3.0:1789181465.095307:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc1825a3b80 x1876092510067328/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181481 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181465.095325:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1825a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876092510067328:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789181465.154634:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789181465.562973:0:11673:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc85df5a40 20000000:00000080:2.0:1789181465.562993:0:11673:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9dc081288400 uarg=0000000000000000 20000000:01000000:2.0:1789181465.563037:0:11673:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1789181465.563043:0:11673:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1789181465.563050:0:11673:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:2.0:1789181465.564641:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1789181465.565258:0:11673:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:0.0:1789181465.575284:0:11673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1789181465.575402:0:11673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:0.0:1789181465.575463:0:11673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:0.0:1789181465.575480:0:11673:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789181465.575502:0:11673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dc189890a00/0x8f4f7840b2e4137d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181465.575523:0:11673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dc1ba785400/0x8f4f7840b2e4121f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91efd1 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181465.575532:0:11673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dc1bfa1ea00/0x8f4f7840b2e41226 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91efd8 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181465.575541:0:11673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dc180030200/0x8f4f7840b2e41234 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e4122d expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181465.575548:0:11673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dc180031c00/0x8f4f7840b2e41242 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e4123b expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181465.575555:0:11673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dc1bfa1fe00/0x8f4f7840b2e41250 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e41249 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181465.575563:0:11673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9dc189890a00/0x8f4f7840b2e4137d lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181465.575607:0:11673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dc1bfa1fe00/0x8f4f7840b2e41250 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8f4f7840b2e41249 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181465.575633:0:11673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dc1bfa1fe00/0x8f4f7840b2e41250 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8f4f7840b2e41249 expref: 18 pid: 5835 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181465.575649:0:11673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c0269880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11673:1876092510067456:0@lo:104: 00000100:00100000:0.0:1789181465.576599:0:11673:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789181465.576852:0:11673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dc180031c00/0x8f4f7840b2e41242 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8f4f7840b2e4123b expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181465.576866:0:11673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dc180031c00/0x8f4f7840b2e41242 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8f4f7840b2e4123b expref: 18 pid: 5837 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181465.576879:0:11673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc19c36c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11673:1876092510067584:0@lo:104: 00000100:00100000:0.0:1789181465.577066:0:11673:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181465.578301:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510067456 00000100:00100000:2.0:1789181465.578317:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510067456 00000100:00100000:2.0:1789181465.578409:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510067584 00000100:00100000:2.0:1789181465.578413:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510067584 00000100:00100000:2.0:1789181465.578433:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789181465.578443:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c0268700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:880710ad-110c-42a4-a174-ab1b99a7ebeb+4:11673:x1876092510067456:12345-0@lo:104: 00010000:00010000:2.0:1789181465.578459:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.132@tcp lock: ffff9dc1c2044800/0x8f4f7840b2e41249 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f4f7840b2e41250 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181465.578542:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789181465.578549:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c0268700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:880710ad-110c-42a4-a174-ab1b99a7ebeb+4:11673:x1876092510067456:12345-0@lo:104: Request processed in 107us (1951us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181465.578557:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789181465.578576:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789181465.578582:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c36f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:880710ad-110c-42a4-a174-ab1b99a7ebeb+3:11673:x1876092510067584:12345-0@lo:104: 00010000:00010000:2.0:1789181465.578591:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.132@tcp lock: ffff9dc180031800/0x8f4f7840b2e4123b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f4f7840b2e41242 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181465.578626:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789181465.578632:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c36f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:880710ad-110c-42a4-a174-ab1b99a7ebeb+3:11673:x1876092510067584:12345-0@lo:104: Request processed in 51us (1567us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181465.578638:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:2.0:1789181465.578659:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789181465.578666:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.132@tcp lock: ffff9dc1c2044800/0x8f4f7840b2e41249 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f4f7840b2e41250 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181465.578674:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1c2044800 already unused, calling callback (ffffffffc1b45c20) 10000000:00010000:2.0:1789181465.578678:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.132@tcp lock: ffff9dc1c2044800/0x8f4f7840b2e41249 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8f4f7840b2e41250 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181465.578821:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.132@tcp lock: ffff9dc1c2044800/0x8f4f7840b2e41249 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8f4f7840b2e41250 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789181465.578833:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.132@tcp lock: ffff9dc1c2044800/0x8f4f7840b2e41249 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8f4f7840b2e41250 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789181465.578839:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789181465.579014:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.132@tcp lock: ffff9dc1c2044800/0x8f4f7840b2e41249 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e41250 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181465.579022:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789181465.579046:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.132@tcp lock: ffff9dc1c2044800/0x8f4f7840b2e41249 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e41250 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181465.579053:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.132@tcp lock: ffff9dc1c2044800/0x8f4f7840b2e41249 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e41250 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181465.579079:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789181465.579082:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.132@tcp lock: ffff9dc180031800/0x8f4f7840b2e4123b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f4f7840b2e41242 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181465.579088:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc180031800 already unused, calling callback (ffffffffc1b45c20) 10000000:00010000:2.0:1789181465.579092:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.132@tcp lock: ffff9dc180031800/0x8f4f7840b2e4123b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8f4f7840b2e41242 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181465.579099:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.132@tcp lock: ffff9dc180031800/0x8f4f7840b2e4123b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8f4f7840b2e41242 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789181465.579105:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.132@tcp lock: ffff9dc180031800/0x8f4f7840b2e4123b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8f4f7840b2e41242 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789181465.579110:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789181465.579126:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.132@tcp lock: ffff9dc180031800/0x8f4f7840b2e4123b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e41242 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181465.579132:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789181465.579137:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.132@tcp lock: ffff9dc180031800/0x8f4f7840b2e4123b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e41242 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181465.579153:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.132@tcp lock: ffff9dc180031800/0x8f4f7840b2e4123b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e41242 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181465.579163:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181465.579164:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181465.579166:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181465.579368:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfa60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:880710ad-110c-42a4-a174-ab1b99a7ebeb:3305:1876092510067712:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789181465.579409:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789181465.579488:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181465.579501:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfa60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:880710ad-110c-42a4-a174-ab1b99a7ebeb:3306:1876092510067840:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789181465.579531:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789181465.579680:0:11673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dc180030200/0x8f4f7840b2e41234 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8f4f7840b2e4122d expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181465.579703:0:11673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dc180030200/0x8f4f7840b2e41234 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8f4f7840b2e4122d expref: 18 pid: 5837 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181465.579715:0:11673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc19c36fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11673:1876092510067968:0@lo:104: 00000100:00100000:0.0:1789181465.579756:0:11673:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789181465.579794:0:11673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dc1bfa1ea00/0x8f4f7840b2e41226 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91efd8 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181465.579808:0:11673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dc1bfa1ea00/0x8f4f7840b2e41226 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91efd8 expref: 12 pid: 5837 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181465.579818:0:11673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc19c36ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11673:1876092510068096:192.168.204.32@tcp:104: 00010000:00010000:0.0:1789181465.579884:0:11673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dc1ba785400/0x8f4f7840b2e4121f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91efd1 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181465.580000:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510067968 00000100:00100000:3.0:1789181465.580009:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510067968 00010000:00010000:0.0:1789181465.580058:0:11673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dc1ba785400/0x8f4f7840b2e4121f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91efd1 expref: 12 pid: 5836 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181465.580060:0:5826:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789181465.580072:0:11673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc19c36f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11673:1876092510068224:192.168.204.32@tcp:104: 00000100:00100000:3.0:1789181465.580080:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789181465.580092:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1ba4a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:880710ad-110c-42a4-a174-ab1b99a7ebeb+3:11673:x1876092510067968:12345-0@lo:104: 00010000:00010000:3.0:1789181465.580105:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1f800/0x8f4f7840b2e4122d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f4f7840b2e41234 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181465.580106:0:11673:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc189a44e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789181465.580134:0:11673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c0269880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11673:1876092510067456:0@lo:104: 00000100:00100000:0.0:1789181465.580147:0:11673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc19c36c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11673:1876092510067584:0@lo:104: 00000100:00100000:0.0:1789181465.580158:0:11673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc19c36fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11673:1876092510067968:0@lo:104: 00010000:00010000:3.0:1789181465.580165:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789181465.580173:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1ba4a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:880710ad-110c-42a4-a174-ab1b99a7ebeb+3:11673:x1876092510067968:12345-0@lo:104: Request processed in 84us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181465.580182:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789181465.580871:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510067712 00000100:00100000:2.0:1789181465.580878:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510067712 00010000:00010000:2.0:1789181465.580965:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dc1bfa1fe00/0x8f4f7840b2e41250 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f4f7840b2e41249 expref: 19 pid: 5835 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181465.580990:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510067840 00000100:00100000:2.0:1789181465.580994:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510067840 00010000:00010000:2.0:1789181465.581005:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dc180031c00/0x8f4f7840b2e41242 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f4f7840b2e4123b expref: 20 pid: 5837 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181465.581030:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789181465.581037:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfa62a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:880710ad-110c-42a4-a174-ab1b99a7ebeb+20:3305:x1876092510067712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789181465.581048:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789181465.581053:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dc1bfa1fe00/0x8f4f7840b2e41250 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f4f7840b2e41249 expref: 20 pid: 5835 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181465.581066:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dc1bfa1fe00/0x8f4f7840b2e41250 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8f4f7840b2e41249 expref: 20 pid: 5835 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181465.581082:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc1bfa1fe00/0x8f4f7840b2e41250 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8f4f7840b2e41249 expref: 20 pid: 5835 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181465.581111:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789181465.581289:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789181465.581298:0:8456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1825a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:3306:x1876092510067840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789181465.581307:0:8456:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789181465.581312:0:8456:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dc180031c00/0x8f4f7840b2e41242 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f4f7840b2e4123b expref: 19 pid: 5837 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181465.581535:0:8456:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dc180031c00/0x8f4f7840b2e41242 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8f4f7840b2e4123b expref: 19 pid: 5837 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181465.581651:0:8456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc180031c00/0x8f4f7840b2e41242 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8f4f7840b2e4123b expref: 19 pid: 5837 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181465.581661:0:8456:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789181465.581706:0:8456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1825a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:880710ad-110c-42a4-a174-ab1b99a7ebeb+18:3306:x1876092510067840:12345-0@lo:103:ldlm_bl.0 Request processed in 410us (2173us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181465.581713:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789181465.582113:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfa60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:880710ad-110c-42a4-a174-ab1b99a7ebeb:3306:1876092510067840:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789181465.582478:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfa62a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:880710ad-110c-42a4-a174-ab1b99a7ebeb+17:3305:x1876092510067712:12345-0@lo:103:ldlm_bl.0 Request processed in 1441us (3068us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181465.582486:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789181465.582514:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfa60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:880710ad-110c-42a4-a174-ab1b99a7ebeb:3305:1876092510067712:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789181465.582558:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789181465.582565:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1f800/0x8f4f7840b2e4122d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f4f7840b2e41234 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181465.582573:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1bfa1f800 already unused, calling callback (ffffffffc1b45c20) 10000000:00010000:3.0:1789181465.582577:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1f800/0x8f4f7840b2e4122d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8f4f7840b2e41234 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181465.582585:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1f800/0x8f4f7840b2e4122d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8f4f7840b2e41234 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789181465.582593:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1f800/0x8f4f7840b2e4122d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8f4f7840b2e41234 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789181465.582598:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789181465.582791:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1f800/0x8f4f7840b2e4122d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e41234 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181465.582799:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789181465.583014:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:3.0:1789181465.583035:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1f800/0x8f4f7840b2e4122d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e41234 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181465.583043:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1f800/0x8f4f7840b2e4122d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e41234 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181465.583059:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181465.583061:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181465.583063:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181465.583255:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfb7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:880710ad-110c-42a4-a174-ab1b99a7ebeb:3304:1876092510068352:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789181465.583303:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181465.583483:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510068352 00000100:00100000:0.0:1789181465.583490:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510068352 00010000:00010000:0.0:1789181465.583519:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dc180030200/0x8f4f7840b2e41234 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f4f7840b2e4122d expref: 17 pid: 5837 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181465.583718:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789181465.583727:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1960f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:880710ad-110c-42a4-a174-ab1b99a7ebeb+17:3304:x1876092510068352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789181465.583739:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789181465.583745:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dc180030200/0x8f4f7840b2e41234 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f4f7840b2e4122d expref: 17 pid: 5837 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181465.583758:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dc180030200/0x8f4f7840b2e41234 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8f4f7840b2e4122d expref: 17 pid: 5837 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181465.583771:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc180030200/0x8f4f7840b2e41234 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8f4f7840b2e4122d expref: 17 pid: 5837 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181465.583784:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789181465.584009:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1960f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:880710ad-110c-42a4-a174-ab1b99a7ebeb+16:3304:x1876092510068352:12345-0@lo:103:ldlm_bl.0 Request processed in 283us (704us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181465.584016:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789181465.584103:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfb7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:880710ad-110c-42a4-a174-ab1b99a7ebeb:3304:1876092510068352:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789181465.587295:0:11673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc19c36ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11673:1876092510068096:192.168.204.32@tcp:104: 00000100:00100000:0.0:1789181465.587313:0:11673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc19c36f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11673:1876092510068224:192.168.204.32@tcp:104: 00010000:00010000:0.0:1789181465.587390:0:11673:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9dc189890a00/0x8f4f7840b2e4137d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181465.588711:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181465.588977:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181465.589870:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488013184 00000100:00100000:1.0:1789181465.589880:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488013184 00010000:00010000:1.0:1789181465.589922:0:6707:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dc1bfa1ea00/0x8f4f7840b2e41226 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91efd8 expref: 13 pid: 5837 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181465.590055:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488013312 00000100:00100000:2.0:1789181465.590060:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488013312 00010000:00010000:2.0:1789181465.590077:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dc1ba785400/0x8f4f7840b2e4121f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91efd1 expref: 14 pid: 5836 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181465.590157:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 33 00000100:00100000:2.0:1789181465.590415:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c36f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:975a0591-a8f7-4a74-9f93-a5aa77f2315c+14:2353:x1876092488013184:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789181465.590433:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789181465.590439:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dc1bfa1ea00/0x8f4f7840b2e41226 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91efd8 expref: 14 pid: 5837 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181465.590451:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dc1bfa1ea00/0x8f4f7840b2e41226 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91efd8 expref: 14 pid: 5837 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181465.590470:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc1bfa1ea00/0x8f4f7840b2e41226 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91efd8 expref: 14 pid: 5837 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181465.590484:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789181465.590548:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c36f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:975a0591-a8f7-4a74-9f93-a5aa77f2315c+13:2353:x1876092488013184:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 137us (1867us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181465.590556:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 33 00000100:00100000:2.0:1789181465.590592:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 34 00000100:00100000:2.0:1789181465.590599:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c36ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:975a0591-a8f7-4a74-9f93-a5aa77f2315c+12:2353:x1876092488013312:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789181465.590608:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789181465.590616:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dc1ba785400/0x8f4f7840b2e4121f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91efd1 expref: 12 pid: 5836 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181465.590625:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dc1ba785400/0x8f4f7840b2e4121f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91efd1 expref: 12 pid: 5836 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181465.590634:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc1ba785400/0x8f4f7840b2e4121f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91efd1 expref: 12 pid: 5836 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181465.590646:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9dc189890a00/0x8f4f7840b2e4137d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181465.590655:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc189890a00/0x8f4f7840b2e4137d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181465.590671:0:5828:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dc189890a00/0x8f4f7840b2e4137d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181465.590678:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dc189890a00/0x8f4f7840b2e4137d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181465.590686:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dc189890a00/0x8f4f7840b2e4137d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181465.590705:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dc189890a00/0x8f4f7840b2e4137d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181465.590711:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc189890a00 already unused, calling callback (ffffffffc152f9b0) 00010000:00010000:2.0:1789181465.590721:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dc189890a00/0x8f4f7840b2e4137d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181465.592062:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dc189890a00/0x8f4f7840b2e4137d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181465.593456:0:11673:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9dc189890a00/0x8f4f7840b2e4137d lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181465.593471:0:11673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dc189890a00/0x8f4f7840b2e4137d lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181465.594445:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dc189890a00/0x8f4f7840b2e4137d lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181465.594468:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc189890a00/0x8f4f7840b2e4137d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181465.594498:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789181465.594938:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c36ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:975a0591-a8f7-4a74-9f93-a5aa77f2315c+11:2353:x1876092488013312:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 4333us (5955us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181465.594950:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 34 00000001:00080000:2.0:1789181465.738705:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967307 is committed 00000004:00080000:2.0:1789181465.738740:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:2.0:1789181465.738774:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:2.0:1789181465.738780:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:2.0:1789181465.739245:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfa60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876092510068480:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789181465.739348:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181465.739418:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510068480 00000100:00100000:3.0:1789181465.739426:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510068480 00000100:00100000:3.0:1789181465.739475:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789181465.739485:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfa63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876092510068480:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1789181465.739514:0:6693:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:3.0:1789181465.739549:0:6693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6aa4be15, atime: 0x6aa4be15, ctime: 0x6aa4be15, blocks: 0x1 00010000:00010000:3.0:1789181465.739558:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097603a78/0x8f4f7840b2e41384 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181465.739576:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=357s v=(0 0) 00010000:00010000:3.0:1789181465.739580:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789181465.739588:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000097603a78/0x8f4f7840b2e41384 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181465.739609:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000097603a78/0x8f4f7840b2e41384 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181465.739621:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097603a78/0x8f4f7840b2e41384 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181465.739629:0:6693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000097603a78/0x8f4f7840b2e41384 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181465.739649:0:6693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789181465.739678:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789181465.739696:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000097603a78/0x8f4f7840b2e41384 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181465.739707:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1bfa1f800 already unused, calling callback (ffffffffc152f9b0) 00010000:00010000:2.0:1789181465.739712:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000097603a78/0x8f4f7840b2e41384 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181465.739800:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000097603a78/0x8f4f7840b2e41384 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181465.739823:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000097603a78/0x8f4f7840b2e41384 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181465.739832:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000097603a78/0x8f4f7840b2e41384 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181465.739857:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181465.739861:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181465.739863:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789181465.740277:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfa63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3304:x1876092510068480:12345-0@lo:6:osp-syn-1-0.0 Request processed in 792us (947us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1789181465.740291:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:2.0:1789181465.740619:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9dc1bfa60700/2, rc 0, transno 4294967300 00000100:00100000:2.0:1789181465.740627:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfa60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876092510068480:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1789181466.174520:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181466.903827:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181466.904716:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488013440 00000100:00100000:1.0:1789181466.904732:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488013440 00000100:00100000:1.0:1789181466.904804:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 251 00000100:00100000:1.0:1789181466.904814:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c372850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:975a0591-a8f7-4a74-9f93-a5aa77f2315c+11:5594:x1876092488013440:12345-192.168.204.32@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789181466.904833:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181466.904853:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc1c2045600/0x8f4f7840b2e4138b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f025 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181466.904880:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc1c2045600/0x8f4f7840b2e4138b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f025 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181466.904892:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc1c2045600/0x8f4f7840b2e4138b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f025 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181466.904901:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1c2045600, rc 0) 00000100:00100000:1.0:1789181466.904976:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c372850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:975a0591-a8f7-4a74-9f93-a5aa77f2315c+12:5594:x1876092488013440:12345-192.168.204.32@tcp:101:ll_cfg_requeue.0 Request processed in 163us (1161us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181466.904983:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 251 00000100:00100000:3.0:1789181466.908060:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181466.908137:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488013568 00000100:00100000:0.0:1789181466.908146:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488013568 00000100:00100000:0.0:1789181466.908207:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 252 00000100:00100000:0.0:1789181466.908217:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c370050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:975a0591-a8f7-4a74-9f93-a5aa77f2315c+12:5594:x1876092488013568:12345-192.168.204.32@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789181466.908520:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c370050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:975a0591-a8f7-4a74-9f93-a5aa77f2315c+12:5594:x1876092488013568:12345-192.168.204.32@tcp:501:ll_cfg_requeue.0 Request processed in 303us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181466.908528:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 252 00000100:00100000:3.0:1789181466.911680:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181466.911976:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488013696 00000100:00100000:2.0:1789181466.911987:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488013696 00000100:00100000:2.0:1789181466.912055:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 253 00000100:00100000:2.0:1789181466.912067:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc18683f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:975a0591-a8f7-4a74-9f93-a5aa77f2315c+12:5594:x1876092488013696:12345-192.168.204.32@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789181466.912382:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc18683f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:975a0591-a8f7-4a74-9f93-a5aa77f2315c+12:5594:x1876092488013696:12345-192.168.204.32@tcp:503:ll_cfg_requeue.0 Request processed in 317us (727us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181466.912390:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 253 00000100:00100000:3.0:1789181466.950682:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181466.951379:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488013824 00000100:00100000:1.0:1789181466.951391:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488013824 00000100:00100000:1.0:1789181466.951461:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 254 00000100:00100000:1.0:1789181466.951473:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc18683f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:975a0591-a8f7-4a74-9f93-a5aa77f2315c+12:9956:x1876092488013824:12345-192.168.204.32@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789181466.951784:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc18683f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:975a0591-a8f7-4a74-9f93-a5aa77f2315c+12:9956:x1876092488013824:12345-192.168.204.32@tcp:502:llog_process_th.0 Request processed in 313us (1129us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181466.951793:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 254 00000100:00100000:1.0:1789181466.960888:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181466.960988:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488013952 00000100:00100000:0.0:1789181466.961000:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488013952 00000100:00100000:0.0:1789181466.961060:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 255 00000100:00100000:0.0:1789181466.961071:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc18683c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:975a0591-a8f7-4a74-9f93-a5aa77f2315c+12:9956:x1876092488013952:12345-192.168.204.32@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789181466.961365:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc18683c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:975a0591-a8f7-4a74-9f93-a5aa77f2315c+12:9956:x1876092488013952:12345-192.168.204.32@tcp:502:llog_process_th.0 Request processed in 294us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181466.961373:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 255 00000100:00100000:3.0:1789181466.973831:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181466.974121:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488014080 00000100:00100000:2.0:1789181466.974132:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488014080 00000100:00100000:2.0:1789181466.974189:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 256 00000100:00100000:2.0:1789181466.974199:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189956c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:975a0591-a8f7-4a74-9f93-a5aa77f2315c+12:5594:x1876092488014080:12345-192.168.204.32@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789181466.974238:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181466.974257:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc1ba785200/0x8f4f7840b2e41392 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f02c expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181466.974286:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc1ba785200/0x8f4f7840b2e41392 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f02c expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181466.974297:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc1ba785200/0x8f4f7840b2e41392 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f02c expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181466.974306:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1ba785200, rc 0) 00000100:00100000:2.0:1789181466.974402:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189956c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:975a0591-a8f7-4a74-9f93-a5aa77f2315c+13:5594:x1876092488014080:12345-192.168.204.32@tcp:101:ll_cfg_requeue.0 Request processed in 204us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181466.974409:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 256 00000100:00100000:3.0:1789181466.989056:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181466.990394:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488014208 00000100:00100000:1.0:1789181466.990409:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488014208 00000100:00100000:1.0:1789181466.990479:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 257 00000100:00100000:1.0:1789181466.990488:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189954c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:975a0591-a8f7-4a74-9f93-a5aa77f2315c+13:5594:x1876092488014208:12345-192.168.204.32@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789181466.991255:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189954c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:975a0591-a8f7-4a74-9f93-a5aa77f2315c+13:5594:x1876092488014208:12345-192.168.204.32@tcp:501:ll_cfg_requeue.0 Request processed in 763us (2204us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181466.991264:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 257 00000100:00100000:1.0:1789181466.998236:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181466.998360:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488014336 00000100:00100000:0.0:1789181466.998384:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488014336 00000100:00100000:0.0:1789181466.998440:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 258 00000100:00100000:0.0:1789181466.998451:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189955450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:975a0591-a8f7-4a74-9f93-a5aa77f2315c+13:5594:x1876092488014336:12345-192.168.204.32@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789181466.998689:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189955450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:975a0591-a8f7-4a74-9f93-a5aa77f2315c+13:5594:x1876092488014336:12345-192.168.204.32@tcp:503:ll_cfg_requeue.0 Request processed in 239us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181466.998698:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 258 00000100:00100000:3.0:1789181467.001589:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181467.001717:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488014464 00000100:00100000:1.0:1789181467.001728:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488014464 00000100:00100000:1.0:1789181467.001786:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 259 00000100:00100000:1.0:1789181467.001797:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189955050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:975a0591-a8f7-4a74-9f93-a5aa77f2315c+13:9959:x1876092488014464:12345-192.168.204.32@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789181467.002826:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189955050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:975a0591-a8f7-4a74-9f93-a5aa77f2315c+13:9959:x1876092488014464:12345-192.168.204.32@tcp:502:llog_process_th.0 Request processed in 1026us (1242us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181467.002837:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 259 00000100:00100000:3.0:1789181467.010814:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181467.010966:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488014592 00000100:00100000:2.0:1789181467.010977:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488014592 00000100:00100000:2.0:1789181467.011033:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 260 00000100:00100000:2.0:1789181467.011042:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189955850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:975a0591-a8f7-4a74-9f93-a5aa77f2315c+13:9959:x1876092488014592:12345-192.168.204.32@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789181467.011298:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189955850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:975a0591-a8f7-4a74-9f93-a5aa77f2315c+13:9959:x1876092488014592:12345-192.168.204.32@tcp:502:llog_process_th.0 Request processed in 256us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181467.011307:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 260 00010000:00010000:2.0:1789181467.198953:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789181467.262731:0:5840:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789181467.262738:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9dc08132f800 from 7 10000000:01000000:2.0:1789181467.262743:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789181467.262792:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc1ba784a00/0x8f4f7840b2e41399 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181467.262822:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.132@tcp lock: ffff9dc1ba784a00/0x8f4f7840b2e41399 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181467.262846:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.132@tcp lock: ffff9dc1ba784a00/0x8f4f7840b2e41399 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181467.262874:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfa62d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510068608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789181467.262946:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181467.262999:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1a72fab40 going to sleep for 11 seconds 00000100:00100000:1.0:1789181467.265077:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510068608 00000100:00100000:1.0:1789181467.265091:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510068608 00000100:00100000:1.0:1789181467.265159:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1789181467.265169:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189957450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+16:5840:x1876092510068608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789181467.265185:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181467.265203:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc1c2044800/0x8f4f7840b2e413a0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f4f7840b2e41399 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181467.265247:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc1c2044800/0x8f4f7840b2e413a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f4f7840b2e41399 expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181467.265259:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc1c2044800/0x8f4f7840b2e413a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e41399 expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181467.265269:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1c2044800, rc 0) 00000100:00100000:2.0:1789181467.265368:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfa62d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510068608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789181467.265373:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189957450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+17:5840:x1876092510068608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 206us (2427us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181467.265379:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00010000:00010000:2.0:1789181467.265386:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.132@tcp lock: ffff9dc1ba784a00/0x8f4f7840b2e41399 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e413a0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181467.265395:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.132@tcp lock: ffff9dc1ba784a00/0x8f4f7840b2e41399 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f4f7840b2e413a0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181467.265561:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfa62d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510068736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789181467.265598:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181467.265678:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1a72fab40 going to sleep for 11 seconds 00000100:00100000:0.0:1789181467.267100:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510068736 00000100:00100000:0.0:1789181467.267110:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510068736 00000100:00100000:0.0:1789181467.267164:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1789181467.267173:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189957c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+17:5840:x1876092510068736:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789181467.267516:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189957c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+17:5840:x1876092510068736:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 344us (1916us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181467.267523:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1789181467.267881:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfa62d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510068736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789181467.267928:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfb7e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510068864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789181467.267973:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181467.268013:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc0821f4b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789181467.268138:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510068864 00000100:00100000:1.0:1789181467.268143:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510068864 00000100:00100000:1.0:1789181467.268178:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1789181467.268186:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189957850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+17:5840:x1876092510068864:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789181467.268373:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189957850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+17:5840:x1876092510068864:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 188us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181467.268381:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1789181467.268688:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfb7e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510068864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789181467.269493:0:11689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfb7e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:880710ad-110c-42a4-a174-ab1b99a7ebeb:11689:1876092510068992:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789181467.269544:0:11689:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181467.269579:0:11689:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc0821f4e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789181467.269700:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510068992 00000100:00100000:1.0:1789181467.269705:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510068992 00000100:00100000:1.0:1789181467.269744:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1789181467.269751:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189956450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+17:11689:x1876092510068992:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789181467.269946:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189956450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+17:11689:x1876092510068992:12345-0@lo:502:llog_process_th.0 Request processed in 195us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181467.269954:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1789181467.270240:0:11689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfb7e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:880710ad-110c-42a4-a174-ab1b99a7ebeb:11689:1876092510068992:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789181467.270264:0:11689:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789181467.270273:0:11689:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789181467.270276:0:11689:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789181467.270282:0:11689:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9dc08132f800 00000020:00000080:3.0:1789181467.270284:0:11689:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789181467.270396:0:11689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfb7e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:880710ad-110c-42a4-a174-ab1b99a7ebeb:11689:1876092510069120:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789181467.272604:0:11689:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181467.272637:0:11689:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc0821f4e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789181467.272726:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510069120 00000100:00100000:0.0:1789181467.272732:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510069120 00000100:00100000:0.0:1789181467.272782:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1789181467.272792:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189957050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+17:11689:x1876092510069120:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789181467.273019:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189957050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+17:11689:x1876092510069120:12345-0@lo:502:llog_process_th.0 Request processed in 228us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181467.273027:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1789181467.274444:0:11689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfb7e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:880710ad-110c-42a4-a174-ab1b99a7ebeb:11689:1876092510069120:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789181467.274482:0:11689:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789181467.274491:0:11689:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789181467.274493:0:11689:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1789181467.274498:0:11689:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1789181467.275456:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1789181467.275480:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789181467.275491:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc1ba784a00/0x8f4f7840b2e41399 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e413a0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181467.275504:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.132@tcp lock: ffff9dc1ba784a00/0x8f4f7840b2e41399 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e413a0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789181467.275527:0:5840:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789181467.275530:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9dc189d1d800 from 7 10000000:01000000:0.0:1789181467.275533:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789181467.275565:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc189891e00/0x8f4f7840b2e413a7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181467.275573:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.132@tcp lock: ffff9dc189891e00/0x8f4f7840b2e413a7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181467.275583:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.132@tcp lock: ffff9dc189891e00/0x8f4f7840b2e413a7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181467.275607:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc19c36fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510069248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789181467.276578:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181467.276630:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1bfab4840 going to sleep for 11 seconds 00000100:00100000:3.0:1789181467.277622:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510069248 00000100:00100000:3.0:1789181467.277633:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510069248 00000100:00100000:3.0:1789181467.277710:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1789181467.277721:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189954850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+17:5840:x1876092510069248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789181467.277736:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181467.277751:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc1bfa1e400/0x8f4f7840b2e413ae lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f4f7840b2e413a7 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181467.277776:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc1bfa1e400/0x8f4f7840b2e413ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f4f7840b2e413a7 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181467.277787:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc1bfa1e400/0x8f4f7840b2e413ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e413a7 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181467.277797:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1bfa1e400, rc 0) 00000100:00100000:0.0:1789181467.279359:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc19c36fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510069248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789181467.279387:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.132@tcp lock: ffff9dc189891e00/0x8f4f7840b2e413a7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e413ae expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181467.279399:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.132@tcp lock: ffff9dc189891e00/0x8f4f7840b2e413a7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f4f7840b2e413ae expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181467.279607:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc19c36fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510069376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789181467.279654:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181467.279709:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1bfab4840 going to sleep for 11 seconds 00000100:00100000:0.0:1789181467.279756:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510069376 00000100:00100000:0.0:1789181467.279762:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510069376 00000100:00100000:0.0:1789181467.279798:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1789181467.279805:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189956050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:5840:x1876092510069376:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789181467.280051:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189956050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:5840:x1876092510069376:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 245us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181467.280058:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1789181467.280109:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc19c36fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510069376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789181467.280136:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc19c36fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510069504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789181467.280171:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181467.280184:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1bfab4840 going to sleep for 11 seconds 00000100:00100000:0.0:1789181467.280194:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510069504 00000100:00100000:0.0:1789181467.280197:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510069504 00000100:00100000:0.0:1789181467.280212:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1789181467.280590:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189954850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:5840:x1876092510069248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2869us (4013us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181467.281534:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189956850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:5840:x1876092510069504:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789181467.281755:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189956850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:5840:x1876092510069504:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 232us (1582us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181467.292441:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1789181467.292699:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc19c36fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510069504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789181467.302735:0:11692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfb7e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:880710ad-110c-42a4-a174-ab1b99a7ebeb:11692:1876092510069632:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789181467.302816:0:11692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181467.302862:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510069632 00000100:00100000:3.0:1789181467.302868:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510069632 00000100:00100000:3.0:1789181467.302902:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1789181467.302910:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189977850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:11692:x1876092510069632:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789181467.303125:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189977850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:11692:x1876092510069632:12345-0@lo:502:llog_process_th.0 Request processed in 215us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181467.303133:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1789181467.303181:0:11692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc0821f46c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789181467.303202:0:11692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfb7e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:880710ad-110c-42a4-a174-ab1b99a7ebeb:11692:1876092510069632:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789181467.303242:0:11692:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789181467.303251:0:11692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789181467.303253:0:11692:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789181467.303259:0:11692:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9dc189d1d800 00000020:00000080:3.0:1789181467.303261:0:11692:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789181467.303909:0:11692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfb7e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:880710ad-110c-42a4-a174-ab1b99a7ebeb:11692:1876092510069760:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789181467.303951:0:11692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181467.303974:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510069760 00000100:00100000:3.0:1789181467.303978:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510069760 00000100:00100000:3.0:1789181467.303998:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1789181467.304005:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189977050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:11692:x1876092510069760:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789181467.304150:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189977050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:11692:x1876092510069760:12345-0@lo:502:llog_process_th.0 Request processed in 144us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181467.304158:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1789181467.304189:0:11692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc0821f46c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789181467.305153:0:11692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfb7e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:880710ad-110c-42a4-a174-ab1b99a7ebeb:11692:1876092510069760:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789181467.306047:0:11692:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789181467.306056:0:11692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789181467.306059:0:11692:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1789181467.306073:0:11692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000100:00100000:0.0:1789181467.314431:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000020:01000000:1.0:1789181467.323588:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1789181467.323631:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789181467.323653:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc189891e00/0x8f4f7840b2e413a7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e413ae expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181467.323678:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.132@tcp lock: ffff9dc189891e00/0x8f4f7840b2e413a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e413ae expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789181467.323696:0:5840:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789181467.323698:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9dc1add60800 from 7 10000000:01000000:1.0:1789181467.323701:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789181467.323740:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc1c2045e00/0x8f4f7840b2e413b5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181467.323749:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.132@tcp lock: ffff9dc1c2045e00/0x8f4f7840b2e413b5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181467.323761:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.132@tcp lock: ffff9dc1c2045e00/0x8f4f7840b2e413b5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181467.323788:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1825a1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510069888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789181467.323873:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181467.323910:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1879a6780 going to sleep for 11 seconds 00000100:00100000:0.0:1789181467.327899:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510069888 00000100:00100000:0.0:1789181467.327927:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510069888 00000100:00100000:0.0:1789181467.327982:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1789181467.327991:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189974850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+18:5840:x1876092510069888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789181467.328007:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181467.328024:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc189890800/0x8f4f7840b2e413bc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f4f7840b2e413b5 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181467.328518:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc189890800/0x8f4f7840b2e413bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f4f7840b2e413b5 expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181467.328550:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc189890800/0x8f4f7840b2e413bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e413b5 expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181467.328559:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc189890800, rc 0) 00000100:00100000:0.0:1789181467.328628:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189974850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:5840:x1876092510069888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 638us (4755us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181467.328635:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1789181467.330481:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1825a1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510069888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789181467.330510:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.132@tcp lock: ffff9dc1c2045e00/0x8f4f7840b2e413b5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e413bc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181467.330524:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.132@tcp lock: ffff9dc1c2045e00/0x8f4f7840b2e413b5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f4f7840b2e413bc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181467.330607:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1825a1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510070016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789181467.330697:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181467.330732:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1879a6780 going to sleep for 11 seconds 00000100:00100000:1.0:1789181467.330809:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510070016 00000100:00100000:1.0:1789181467.330816:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510070016 00000100:00100000:1.0:1789181467.330873:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1789181467.330881:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189976050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:5840:x1876092510070016:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789181467.331966:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189976050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:5840:x1876092510070016:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1082us (1274us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181467.331976:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1789181467.332012:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1825a1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510070016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789181467.332052:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1825a1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510070144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789181467.334383:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181467.336177:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1879a6780 going to sleep for 11 seconds 00000100:00100000:0.0:1789181467.337664:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510070144 00000100:00100000:0.0:1789181467.337681:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510070144 00000100:00100000:0.0:1789181467.337739:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1789181467.337750:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189976850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:5840:x1876092510070144:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789181467.338018:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189976850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:5840:x1876092510070144:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 270us (3640us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181467.338026:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1789181467.338703:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1825a1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:880710ad-110c-42a4-a174-ab1b99a7ebeb:5840:1876092510070144:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789181467.343131:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789181467.345429:0:11693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfb7e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:880710ad-110c-42a4-a174-ab1b99a7ebeb:11693:1876092510070272:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789181467.345513:0:11693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181467.345549:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510070272 00000100:00100000:3.0:1789181467.345555:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510070272 00000100:00100000:3.0:1789181467.345602:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1789181467.345611:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189974050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:11693:x1876092510070272:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789181467.345859:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189974050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:11693:x1876092510070272:12345-0@lo:502:llog_process_th.0 Request processed in 248us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181467.345868:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1789181467.345940:0:11693:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc0821f46c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789181467.345961:0:11693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfb7e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:880710ad-110c-42a4-a174-ab1b99a7ebeb:11693:1876092510070272:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789181467.345989:0:11693:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789181467.345998:0:11693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789181467.346000:0:11693:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789181467.346007:0:11693:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9dc1add60800 00000020:00000080:3.0:1789181467.346010:0:11693:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789181467.346076:0:11693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfb7e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:880710ad-110c-42a4-a174-ab1b99a7ebeb:11693:1876092510070400:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789181467.346107:0:11693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181467.346121:0:11693:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc0821f46c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789181467.346132:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510070400 00000100:00100000:3.0:1789181467.346136:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510070400 00000100:00100000:3.0:1789181467.346158:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1789181467.346164:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189975c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:11693:x1876092510070400:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789181467.346271:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189975c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:11693:x1876092510070400:12345-0@lo:502:llog_process_th.0 Request processed in 107us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181467.346277:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1789181467.346309:0:11693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfb7e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:880710ad-110c-42a4-a174-ab1b99a7ebeb:11693:1876092510070400:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789181467.346325:0:11693:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789181467.346358:0:11693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789181467.346361:0:11693:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1789181467.346364:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1789181467.346406:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1789181467.346420:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789181467.346429:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc1c2045e00/0x8f4f7840b2e413b5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e413bc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181467.346441:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.132@tcp lock: ffff9dc1c2045e00/0x8f4f7840b2e413b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e413bc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181467.650018:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789181467.650043:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfa62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876092510070528:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789181467.650114:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181467.652941:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510070528 00000100:00100000:2.0:1789181467.652956:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510070528 00000100:00100000:2.0:1789181467.653054:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789181467.653066:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1825a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876092510070528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789181467.653108:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789181467.653204:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1825a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876092510070528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 141us (3090us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181467.653232:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:1.0:1789181467.653363:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc1bfa62300 x1876092510070528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181483 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181467.653383:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfa62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876092510070528:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789181467.653507:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789181468.222672:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789181468.352903:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789181468.761230:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181468.761273:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181468.761428:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181468.761455:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181468.761488:0:6887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488014848 00000100:00100000:2.0:1789181468.761498:0:6887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488014848 00000100:00100000:2.0:1789181468.761551:0:6887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488015104 00000100:00100000:2.0:1789181468.761555:0:6887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488015104 00000100:00100000:2.0:1789181468.761580:0:6887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 108 00000100:00100000:2.0:1789181468.761590:0:6887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfa62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+5:2354:x1876092488014848:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:2.0:1789181468.761676:0:6887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfa62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+5:2354:x1876092488014848:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 76us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181468.761683:0:6887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 108 00000100:00100000:2.0:1789181468.761702:0:6887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 109 00000100:00100000:2.0:1789181468.761708:0:6887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfa62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7badad21-a177-49b1-a2af-7b11e28c02ce+5:2354:x1876092488015104:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:2.0:1789181468.761731:0:6887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfa62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7badad21-a177-49b1-a2af-7b11e28c02ce+5:2354:x1876092488015104:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 24us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181468.761736:0:6887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 109 00000100:00080000:3.0:1789181468.762009:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789181468.762022:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488014720 00000100:00100000:3.0:1789181468.762034:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488014720 00000100:00100000:3.0:1789181468.762067:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 276 00000100:00100000:3.0:1789181468.762074:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189974450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:975a0591-a8f7-4a74-9f93-a5aa77f2315c+13:2353:x1876092488014720:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:3.0:1789181468.762106:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189974450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:975a0591-a8f7-4a74-9f93-a5aa77f2315c+13:2353:x1876092488014720:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 33us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181468.762113:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 276 00000100:00100000:0.0:1789181468.769659:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488014976 00000100:00100000:0.0:1789181468.769679:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488014976 00000100:00100000:0.0:1789181468.769784:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 62 00000100:00100000:0.0:1789181468.769797:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfa60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+5:2353:x1876092488014976:12345-192.168.204.32@tcp:400:kworker.0 00000100:00080000:3.0:1789181468.769798:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789181468.769894:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfa60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+5:2353:x1876092488014976:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 100us (8619us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181468.769902:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 62 00010000:00010000:2.0:1789181469.246729:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181469.694763:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfa60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876092510070784:0@lo:400:kworker.0 00000100:00100000:2.0:1789181469.694833:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181469.694894:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1baadf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876092510071296:0@lo:400:kworker.0 00000100:00100000:2.0:1789181469.694922:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181469.694953:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789181469.694967:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfa61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1876092510070912:0@lo:400:kworker.0 00000100:00100000:2.0:1789181469.694992:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181469.695164:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfa63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510071040:0@lo:400:kworker.0 00000100:00100000:0.0:1789181469.695195:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181469.695220:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789181469.695227:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfa62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:880710ad-110c-42a4-a174-ab1b99a7ebeb:3305:1876092510070656:0@lo:400:kworker.0 00000100:00100000:0.0:1789181469.695263:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181469.695283:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1baadea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1876092510071168:0@lo:400:kworker.0 00000100:00100000:0.0:1789181469.695302:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181469.695361:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510070784 00000100:00100000:0.0:1789181469.695368:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510070784 00000100:00100000:0.0:1789181469.695410:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510070912 00000100:00100000:0.0:1789181469.695413:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510070912 00000100:00100000:0.0:1789181469.695435:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510071168 00000100:00100000:0.0:1789181469.695438:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510071168 00000100:00100000:0.0:1789181469.695453:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789181469.695461:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1baade300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876092510070784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181469.695511:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1baade300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876092510070784:12345-0@lo:400:kworker.0 Request processed in 50us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181469.695519:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789181469.695536:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789181469.695541:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1baadf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876092510070912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181469.695578:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1baadf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876092510070912:12345-0@lo:400:kworker.0 Request processed in 37us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181469.695583:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789181469.695593:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789181469.695598:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c36e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876092510071168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181469.695635:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c36e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876092510071168:12345-0@lo:400:kworker.0 Request processed in 37us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181469.695641:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:0.0:1789181469.695660:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789181469.695686:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1baadea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1876092510071168:0@lo:400:kworker.0 00000100:00100000:0.0:1789181469.695722:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfa61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1876092510070912:0@lo:400:kworker.0 00000100:00100000:0.0:1789181469.695732:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfa60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876092510070784:0@lo:400:kworker.0 00000100:00100000:3.0:1789181469.695998:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510071296 00000100:00100000:3.0:1789181469.696003:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510071296 00000100:00100000:3.0:1789181469.696061:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510071040 00000100:00100000:3.0:1789181469.696064:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510071040 00000100:00100000:3.0:1789181469.696088:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789181469.696095:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1baadce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3303:x1876092510071296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181469.696135:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1baadce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3303:x1876092510071296:12345-0@lo:400:kworker.0 Request processed in 41us (1213us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181469.696141:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789181469.696154:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789181469.696161:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c36c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510071040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181469.696193:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c36c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510071040:12345-0@lo:400:kworker.0 Request processed in 32us (996us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181469.696198:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:3.0:1789181469.696229:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc1bfa63480 x1876092510071040/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181485 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181469.696240:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfa63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510071040:0@lo:400:kworker.0 00000100:00100000:3.0:1789181469.696263:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1baadf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876092510071296:0@lo:400:kworker.0 00000100:00100000:3.0:1789181469.696279:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510070656 00000100:00100000:3.0:1789181469.696282:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510070656 00000100:00100000:3.0:1789181469.696306:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1789181469.696311:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189976c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:3305:x1876092510070656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181469.696373:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189976c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:3305:x1876092510070656:12345-0@lo:400:kworker.0 Request processed in 62us (1108us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181469.696379:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1789181469.696402:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfa62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:880710ad-110c-42a4-a174-ab1b99a7ebeb:3305:1876092510070656:0@lo:400:kworker.0 00000100:00080000:0.0:1789181469.696891:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789181469.696895:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789181470.206622:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1825a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876092510071424:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789181470.206707:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181470.206867:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510071424 00000100:00100000:2.0:1789181470.206876:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510071424 00000100:00100000:2.0:1789181470.206934:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789181470.206946:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1876092510071424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789181470.206979:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789181470.207035:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1876092510071424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181470.207043:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789181470.207176:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1825a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876092510071424:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789181470.270642:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789181470.755545:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00010000:00010000:2.0:1789181471.294652:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181472.322497:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181472.766629:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789181472.766653:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1baadca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876092510071552:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789181472.766723:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181472.767225:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510071552 00000100:00100000:2.0:1789181472.767235:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510071552 00000100:00100000:2.0:1789181472.767308:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789181472.767319:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1825a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876092510071552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789181472.767402:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789181472.767457:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1825a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876092510071552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 141us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181472.767464:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:2.0:1789181472.767509:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc1baadca80 x1876092510071552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181488 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181472.767528:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1baadca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876092510071552:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789181472.768871:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789181473.343493:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789181473.892050:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181473.892446:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181473.892484:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181473.892517:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181473.892556:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488015360 00000100:00100000:3.0:1789181473.892567:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488015360 00000100:00100000:3.0:1789181473.892627:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488015616 00000100:00100000:3.0:1789181473.892630:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488015616 00000100:00100000:3.0:1789181473.892656:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 113 00000100:00100000:3.0:1789181473.892668:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+5:2353:x1876092488015360:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:3.0:1789181473.892740:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+5:2353:x1876092488015360:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 74us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181473.892748:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 113 00000100:00100000:3.0:1789181473.892763:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 114 00000100:00100000:3.0:1789181473.892769:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7badad21-a177-49b1-a2af-7b11e28c02ce+5:2353:x1876092488015616:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:3.0:1789181473.892791:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7badad21-a177-49b1-a2af-7b11e28c02ce+5:2353:x1876092488015616:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 23us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181473.892796:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 114 00000100:00080000:3.0:1789181473.892813:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789181473.893495:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488015488 00000100:00100000:1.0:1789181473.893501:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488015488 00000100:00100000:1.0:1789181473.893561:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 65 00000100:00100000:1.0:1789181473.893570:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+5:2353:x1876092488015488:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:1.0:1789181473.893606:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+5:2353:x1876092488015488:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 38us (1160us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181473.893612:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 65 00000100:00080000:3.0:1789181473.893909:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789181473.895150:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488015232 00000100:00100000:0.0:1789181473.895159:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488015232 00000100:00100000:0.0:1789181473.895634:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 278 00000100:00100000:0.0:1789181473.895645:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189974c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:975a0591-a8f7-4a74-9f93-a5aa77f2315c+13:2353:x1876092488015232:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:0.0:1789181473.895727:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189974c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:975a0591-a8f7-4a74-9f93-a5aa77f2315c+13:2353:x1876092488015232:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 85us (3690us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181473.895735:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 278 00010000:00010000:3.0:1789181474.366612:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789181474.814590:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789181474.814732:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1baaddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1876092510071936:0@lo:400:kworker.0 00000100:00100000:0.0:1789181474.814732:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1baaded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876092510071808:0@lo:400:kworker.0 00000100:00100000:0.0:1789181474.814819:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181474.814838:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789181474.814853:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1baadfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876092510072064:0@lo:400:kworker.0 00000100:00100000:3.0:1789181474.814888:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1baadca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:880710ad-110c-42a4-a174-ab1b99a7ebeb:3305:1876092510071680:0@lo:400:kworker.0 00000100:00100000:1.0:1789181474.814944:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181474.814964:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181474.815006:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510072064 00000100:00100000:0.0:1789181474.815011:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510071808 00000100:00100000:1.0:1789181474.815014:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510072064 00000100:00100000:0.0:1789181474.815018:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510071808 00000100:00100000:0.0:1789181474.815064:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510071936 00000100:00100000:0.0:1789181474.815068:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510071936 00000100:00100000:1.0:1789181474.815072:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789181474.815084:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1825a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876092510072064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181474.815101:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789181474.815110:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c36e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876092510071808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181474.815145:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1825a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876092510072064:12345-0@lo:400:kworker.0 Request processed in 63us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181474.815152:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789181474.815161:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c36e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876092510071808:12345-0@lo:400:kworker.0 Request processed in 52us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181474.815168:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789181474.815183:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1789181474.815189:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c36d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876092510071936:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1789181474.815213:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc1baadfb80 x1876092510072064/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181490 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181474.815226:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1baadfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876092510072064:0@lo:400:kworker.0 00000100:00100000:0.0:1789181474.815239:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c36d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876092510071936:12345-0@lo:400:kworker.0 Request processed in 48us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181474.815247:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789181474.815297:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1baaded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876092510071808:0@lo:400:kworker.0 00000100:00100000:0.0:1789181474.815366:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1baaddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1876092510071936:0@lo:400:kworker.0 00000100:00100000:2.0:1789181474.815381:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1baadc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1876092510072192:0@lo:400:kworker.0 00000100:00100000:0.0:1789181474.815382:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789181474.815395:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1baaddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876092510072320:0@lo:400:kworker.0 00000100:00080000:1.0:1789181474.815405:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789181474.815412:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789181474.815427:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181474.815435:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181474.815455:0:6887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510072192 00000100:00100000:1.0:1789181474.815461:0:6887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510072192 00000100:00100000:2.0:1789181474.815482:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510072320 00000100:00080000:0.0:1789181474.815486:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789181474.815495:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510072320 00000100:00100000:1.0:1789181474.815501:0:6887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00080000:0.0:1789181474.815532:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789181474.815549:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789181474.815559:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c36fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876092510072320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181474.815726:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000100:00100000:2.0:1789181474.815728:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c36fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876092510072320:12345-0@lo:400:kworker.0 Request processed in 169us (292us total) trans 0 rc 0/0 00000004:00080000:0.0:1789181474.815734:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9dc1bfa60700, transno 4294967300 00000100:00100000:2.0:1789181474.815739:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789181474.815751:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1baaddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876092510072320:0@lo:400:kworker.0 00000100:00100000:1.0:1789181474.816289:0:6887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1baadd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876092510072192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181474.816316:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181474.816346:0:6887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1baadd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876092510072192:12345-0@lo:400:kworker.0 Request processed in 823us (906us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181474.816354:0:6887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789181474.816530:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510071680 00000100:00100000:2.0:1789181474.816532:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1baadc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1876092510072192:0@lo:400:kworker.0 00000100:00100000:0.0:1789181474.816534:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510071680 00000100:00100000:0.0:1789181474.816571:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1789181474.816579:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189975450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:3305:x1876092510071680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181474.816623:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189975450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:3305:x1876092510071680:12345-0@lo:400:kworker.0 Request processed in 44us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181474.816629:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1789181474.816749:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1baadca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:880710ad-110c-42a4-a174-ab1b99a7ebeb:3305:1876092510071680:0@lo:400:kworker.0 00000100:00100000:2.0:1789181475.326591:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789181475.326614:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1825a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876092510072448:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789181475.326681:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181475.326837:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510072448 00000100:00100000:1.0:1789181475.326845:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510072448 00000100:00100000:1.0:1789181475.326897:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789181475.326906:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1baadc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876092510072448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789181475.326941:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789181475.326995:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1baadc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876092510072448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181475.327002:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789181475.327154:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1825a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876092510072448:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789181475.391519:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181476.414491:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181477.444759:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181477.886751:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1baadd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510072576:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789181477.886847:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181477.889118:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510072576 00000100:00100000:0.0:1789181477.889135:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510072576 00000100:00100000:0.0:1789181477.889282:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789181477.889294:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1825a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510072576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789181477.889365:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789181477.889465:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1825a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510072576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 164us (2608us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181477.889500:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:3.0:1789181477.889880:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc1baadd180 x1876092510072576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181493 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181477.889901:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1baadd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510072576:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789181477.892229:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789181478.462515:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789181478.591451:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789181478.997452:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181478.997506:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181478.997539:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181478.997575:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181478.997655:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488015744 00000100:00100000:0.0:1789181478.997666:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488015744 00000100:00100000:0.0:1789181478.997726:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 280 00000100:00100000:0.0:1789181478.997738:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189975050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:975a0591-a8f7-4a74-9f93-a5aa77f2315c+13:2353:x1876092488015744:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:0.0:1789181478.997816:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189975050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:975a0591-a8f7-4a74-9f93-a5aa77f2315c+13:2353:x1876092488015744:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 80us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181478.997824:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 280 00000100:00100000:2.0:1789181478.998202:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488015872 00000100:00100000:2.0:1789181478.998207:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488015872 00000100:00080000:0.0:1789181478.998318:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789181478.998388:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488016128 00000100:00100000:2.0:1789181478.998392:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488016128 00000100:00080000:0.0:1789181478.998456:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789181478.998627:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488016000 00000100:00100000:1.0:1789181478.998631:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488016000 00000100:00100000:1.0:1789181478.998678:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 68 00000100:00100000:1.0:1789181478.998687:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+5:2353:x1876092488016000:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:1.0:1789181478.998732:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+5:2353:x1876092488016000:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 46us (1225us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181478.998753:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 68 00000100:00080000:0.0:1789181478.998802:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789181479.002775:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 118 00000100:00100000:3.0:1789181479.002797:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+5:2354:x1876092488015872:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:3.0:1789181479.002885:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+5:2354:x1876092488015872:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 98us (5345us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181479.002893:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 118 00000100:00100000:3.0:1789181479.002920:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 119 00000100:00100000:3.0:1789181479.003242:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7badad21-a177-49b1-a2af-7b11e28c02ce+5:2354:x1876092488016128:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:3.0:1789181479.003283:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7badad21-a177-49b1-a2af-7b11e28c02ce+5:2354:x1876092488016128:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 46us (5707us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181479.003290:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 119 00010000:00010000:2.0:1789181479.487413:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181479.936403:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789181479.936438:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1baadc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:880710ad-110c-42a4-a174-ab1b99a7ebeb:3305:1876092510072704:0@lo:400:kworker.0 00000100:00100000:2.0:1789181479.936510:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181479.936580:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510072704 00000100:00100000:2.0:1789181479.936588:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510072704 00000100:00100000:2.0:1789181479.936644:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1789181479.936653:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189975850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:3305:x1876092510072704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181479.936718:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189975850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:3305:x1876092510072704:12345-0@lo:400:kworker.0 Request processed in 66us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181479.936750:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1789181479.936752:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1baadc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:880710ad-110c-42a4-a174-ab1b99a7ebeb:3305:1876092510072704:0@lo:400:kworker.0 00000100:00100000:2.0:1789181479.936816:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1baadd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876092510072832:0@lo:400:kworker.0 00000100:00100000:2.0:1789181479.936845:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181479.936878:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510072832 00000100:00100000:2.0:1789181479.936882:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510072832 00000100:00100000:2.0:1789181479.936909:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789181479.936916:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1baade680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876092510072832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181479.936951:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1baade680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876092510072832:12345-0@lo:400:kworker.0 Request processed in 37us (106us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181479.936958:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789181479.936986:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1baadd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876092510072832:0@lo:400:kworker.0 00000100:00100000:2.0:1789181479.937015:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789181479.937021:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1baadd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1876092510072960:0@lo:400:kworker.0 00000100:00100000:2.0:1789181479.937044:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181479.937068:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510072960 00000100:00100000:2.0:1789181479.937072:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510072960 00000100:00100000:2.0:1789181479.937114:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789181479.937121:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1baadf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876092510072960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181479.937154:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1baadf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876092510072960:12345-0@lo:400:kworker.0 Request processed in 34us (109us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181479.937160:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:3.0:1789181479.937181:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789181479.937187:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1baadd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1876092510072960:0@lo:400:kworker.0 00000100:00100000:2.0:1789181479.937243:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1baadc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876092510073344:0@lo:400:kworker.0 00000100:00100000:2.0:1789181479.937270:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181479.937294:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1baadd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510073088:0@lo:400:kworker.0 00000100:00100000:3.0:1789181479.937351:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181479.937375:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789181479.937380:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1baadc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1876092510073216:0@lo:400:kworker.0 00000100:00100000:3.0:1789181479.937401:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181479.937624:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510073344 00000100:00100000:0.0:1789181479.937629:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510073344 00000100:00100000:0.0:1789181479.937679:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510073088 00000100:00100000:0.0:1789181479.937682:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510073088 00000100:00080000:3.0:1789181479.937707:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789181479.937711:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789181479.937726:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789181479.937746:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1baadd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1876092510073344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181479.937787:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1baadd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1876092510073344:12345-0@lo:400:kworker.0 Request processed in 55us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181479.937793:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789181479.937805:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789181479.937811:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510073088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181479.937842:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510073088:12345-0@lo:400:kworker.0 Request processed in 32us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181479.937847:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789181479.937874:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1baadc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876092510073344:0@lo:400:kworker.0 00010000:00080000:0.0:1789181479.937923:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc1baadd500 x1876092510073088/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181495 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181479.937933:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1baadd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510073088:0@lo:400:kworker.0 00000100:00100000:2.0:1789181479.938298:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510073216 00000100:00100000:2.0:1789181479.938303:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510073216 00000100:00100000:2.0:1789181479.938370:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789181479.938378:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876092510073216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181479.938429:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876092510073216:12345-0@lo:400:kworker.0 Request processed in 52us (1026us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181479.938436:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:3.0:1789181479.938590:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789181479.938671:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1baadc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1876092510073216:0@lo:400:kworker.0 00000100:00100000:0.0:1789181480.446900:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789181480.446925:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1825a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876092510073472:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789181480.447000:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181480.448984:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510073472 00000100:00100000:3.0:1789181480.448998:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510073472 00000100:00100000:3.0:1789181480.449060:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789181480.449071:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c36f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876092510073472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789181480.449108:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789181480.449419:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c36f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876092510073472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 348us (2417us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181480.449427:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789181480.449659:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1825a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876092510073472:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789181480.510516:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181481.534853:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181482.559898:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181483.006717:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789181483.006741:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1baadca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876092510073600:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789181483.006810:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181483.006959:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510073600 00000100:00100000:2.0:1789181483.006969:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510073600 00000100:00100000:2.0:1789181483.007040:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789181483.007050:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1825a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876092510073600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789181483.007088:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789181483.007140:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1825a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876092510073600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181483.007147:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:3.0:1789181483.007202:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789181483.007730:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc1baadca80 x1876092510073600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181499 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181483.007754:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1baadca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876092510073600:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789181483.582873:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181484.131088:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181484.131131:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181484.131167:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181484.131208:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181484.131251:0:6887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488016384 00000100:00100000:1.0:1789181484.131371:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488016512 00000100:00100000:1.0:1789181484.131386:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488016512 00000100:00100000:1.0:1789181484.131448:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 19 00000100:00100000:1.0:1789181484.131459:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfa60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+5:2350:x1876092488016512:12345-192.168.204.32@tcp:9:kworker.0 00000020:00000080:1.0:1789181484.131498:0:6691:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8f4f7840b2e412f8 00000100:00080000:1.0:1789181484.131507:0:6691:0:(import.c:65:import_set_state_nolock()) ffff9dc1a7384000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789181484.131544:0:6691:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:1.0:1789181484.131805:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfa60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+2:2350:x1876092488016512:12345-192.168.204.32@tcp:9:kworker.0 Request processed in 347us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181484.131812:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 19 00000100:00100000:2.0:1789181484.131968:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488016640 00000100:00100000:2.0:1789181484.131975:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488016640 00000100:00100000:2.0:1789181484.132018:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 123 00000100:00100000:2.0:1789181484.132028:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfa62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7badad21-a177-49b1-a2af-7b11e28c02ce+5:2354:x1876092488016640:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:2.0:1789181484.132074:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfa62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7badad21-a177-49b1-a2af-7b11e28c02ce+5:2354:x1876092488016640:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 48us (865us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181484.132080:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 123 00000100:00100000:0.0:1789181484.132770:0:6887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488016384 00000100:00100000:0.0:1789181484.132821:0:6887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 124 00000100:00100000:0.0:1789181484.132830:0:6887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c36f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+5:2353:x1876092488016384:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:0.0:1789181484.132870:0:6887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c36f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+5:2353:x1876092488016384:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 42us (1739us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181484.132877:0:6887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 124 00000100:00100000:3.0:1789181484.136559:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488016256 00000100:00100000:3.0:1789181484.136573:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488016256 00000100:00100000:3.0:1789181484.136645:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 282 00000100:00100000:3.0:1789181484.136657:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189976450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:975a0591-a8f7-4a74-9f93-a5aa77f2315c+13:2353:x1876092488016256:12345-192.168.204.32@tcp:400:kworker.0 00000100:00080000:2.0:1789181484.136692:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789181484.136700:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789181484.136718:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789181484.136729:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189976450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:975a0591-a8f7-4a74-9f93-a5aa77f2315c+13:2353:x1876092488016256:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 73us (5652us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181484.136736:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 282 00010000:00010000:2.0:1789181484.608667:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181485.054605:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1baaddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876092510073856:0@lo:400:kworker.0 00000100:00100000:2.0:1789181485.054616:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1baaded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1876092510073984:0@lo:400:kworker.0 00000100:00100000:0.0:1789181485.054660:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789181485.054677:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1baaddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:880710ad-110c-42a4-a174-ab1b99a7ebeb:3305:1876092510073728:0@lo:400:kworker.0 00000100:00100000:2.0:1789181485.054685:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181485.054792:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510073984 00000100:00100000:1.0:1789181485.054800:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510073984 00000100:00100000:1.0:1789181485.054854:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1789181485.054864:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1baadfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876092510073984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181485.055874:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181485.055946:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510073728 00000100:00100000:0.0:1789181485.055951:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510073728 00000100:00100000:0.0:1789181485.055985:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1789181485.056005:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189977450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:3305:x1876092510073728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181485.056048:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189977450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:3305:x1876092510073728:12345-0@lo:400:kworker.0 Request processed in 44us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181485.056055:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1789181485.056463:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1baaddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:880710ad-110c-42a4-a174-ab1b99a7ebeb:3305:1876092510073728:0@lo:400:kworker.0 00000100:00080000:0.0:1789181485.056503:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789181485.067275:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789181485.067290:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1baaddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876092510074368:0@lo:400:kworker.0 00000100:00100000:2.0:1789181485.067378:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181485.067412:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510074368 00000100:00100000:2.0:1789181485.067420:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510074368 00000100:00100000:2.0:1789181485.067483:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789181485.067492:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1baadca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876092510074368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181485.067542:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1baadca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876092510074368:12345-0@lo:400:kworker.0 Request processed in 52us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181485.067549:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789181485.067589:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1baaddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876092510074368:0@lo:400:kworker.0 00000100:00100000:2.0:1789181485.067634:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1baadea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1876092510074240:0@lo:400:kworker.0 00000100:00100000:2.0:1789181485.067661:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181485.067681:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789181485.067687:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1baadf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876092510074112:0@lo:400:kworker.0 00000100:00100000:2.0:1789181485.067707:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181485.067734:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510074240 00000100:00100000:2.0:1789181485.067738:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510074240 00000100:00100000:2.0:1789181485.067767:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1789181485.067774:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1baaddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876092510074240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181485.067812:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1baaddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876092510074240:12345-0@lo:400:kworker.0 Request processed in 39us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181485.067818:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1789181485.067844:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1baadea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1876092510074240:0@lo:400:kworker.0 00000100:00080000:0.0:1789181485.067858:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789181485.067865:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789181485.067892:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510074112 00000100:00100000:2.0:1789181485.067897:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510074112 00000100:00080000:0.0:1789181485.067912:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789181485.067930:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789181485.067938:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1baadc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876092510074112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181485.067984:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1baadc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876092510074112:12345-0@lo:400:kworker.0 Request processed in 46us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181485.067991:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00080000:0.0:1789181485.068020:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc1baadf100 x1876092510074112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181501 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181485.068033:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1baadf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876092510074112:0@lo:400:kworker.0 00000100:00100000:3.0:1789181485.069328:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181485.069613:0:6887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510073856 00000100:00100000:0.0:1789181485.069621:0:6887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510073856 00000100:00100000:0.0:1789181485.069666:0:6887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1789181485.069675:0:6887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc18854bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876092510073856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181485.069744:0:6887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc18854bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876092510073856:12345-0@lo:400:kworker.0 Request processed in 71us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181485.069752:0:6887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789181485.069844:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1baaddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876092510073856:0@lo:400:kworker.0 00000100:00100000:1.0:1789181485.071698:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1baadfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876092510073984:12345-0@lo:400:kworker.0 Request processed in 16828us (17006us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181485.071726:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1789181485.075727:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1baaded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1876092510073984:0@lo:400:kworker.0 00000100:00100000:0.0:1789181485.567995:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789181485.568019:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1825a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876092510074496:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789181485.568092:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181485.568566:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510074496 00000100:00100000:1.0:1789181485.568574:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510074496 00000100:00100000:1.0:1789181485.568627:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789181485.568637:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfa63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876092510074496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789181485.568672:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789181485.568725:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfa63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876092510074496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181485.568731:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789181485.568923:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1825a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876092510074496:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789181485.632008:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789181486.155446:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5971a429-48ca-4c07-88a3-fa58102a53bc 00000020:00000080:2.0:1789181486.155456:0:7647:0:(genops.c:885:class_export_put()) final put ffff9dc1a7381000/5971a429-48ca-4c07-88a3-fa58102a53bc 00000020:00000080:2.0:1789181486.155482:0:11708:0:(genops.c:844:class_export_destroy()) destroying export ffff9dc1a7381000/5971a429-48ca-4c07-88a3-fa58102a53bc for lustre-OST0001 00000020:00000080:2.0:1789181486.155521:0:11708:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9dc1a7384000 for lustre-OST0001 00010000:00010000:2.0:1789181486.655419:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181487.678902:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789181488.126612:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789181488.131896:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1baadea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876092510074624:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789181488.131980:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181488.132186:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510074624 00000100:00100000:1.0:1789181488.132195:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510074624 00000100:00100000:1.0:1789181488.132272:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789181488.132283:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c0269880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876092510074624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789181488.132318:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789181488.132384:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c0269880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876092510074624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181488.132392:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:0.0:1789181488.132455:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789181488.132569:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc1baadea00 x1876092510074624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181504 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181488.132590:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1baadea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876092510074624:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789181488.703536:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789181488.831150:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789181489.238090:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181489.238171:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181489.238205:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181489.239639:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488017024 00000100:00100000:2.0:1789181489.239652:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488017024 00000100:00100000:2.0:1789181489.239732:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488016896 00000100:00100000:2.0:1789181489.239736:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488016896 00000100:00100000:2.0:1789181489.239762:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 128 00000100:00100000:2.0:1789181489.239772:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1825a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7badad21-a177-49b1-a2af-7b11e28c02ce+5:2354:x1876092488017024:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:2.0:1789181489.239848:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1825a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7badad21-a177-49b1-a2af-7b11e28c02ce+5:2354:x1876092488017024:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 77us (1676us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181489.239855:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 128 00000100:00100000:2.0:1789181489.239874:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 129 00000100:00100000:2.0:1789181489.239882:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1825a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+5:2353:x1876092488016896:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:2.0:1789181489.239925:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1825a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+5:2353:x1876092488016896:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 44us (1719us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181489.239932:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 129 00000100:00080000:1.0:1789181489.240714:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789181489.242996:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488016768 00000100:00100000:3.0:1789181489.243009:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488016768 00000100:00100000:2.0:1789181489.245054:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 284 00000100:00100000:2.0:1789181489.245068:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189977c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:975a0591-a8f7-4a74-9f93-a5aa77f2315c+13:2354:x1876092488016768:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:2.0:1789181489.245154:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189977c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:975a0591-a8f7-4a74-9f93-a5aa77f2315c+13:2354:x1876092488016768:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 89us (7074us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181489.245161:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 284 00000001:02000400:3.0:1789181489.421200:0:11859:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 22:51:29 (1789181489) 00010000:00010000:2.0:1789181489.726810:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181490.174627:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789181490.174727:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1baadc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876092510074880:0@lo:400:kworker.0 00000100:00100000:1.0:1789181490.174803:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181490.175158:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1baadea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1876092510075008:0@lo:400:kworker.0 00000100:00100000:3.0:1789181490.175195:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181490.175257:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510074880 00000100:00100000:3.0:1789181490.175265:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510074880 00000100:00100000:3.0:1789181490.175311:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510075008 00000100:00100000:3.0:1789181490.175314:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510075008 00000100:00100000:3.0:1789181490.175371:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789181490.175380:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1825a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876092510074880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181490.177452:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1baadd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:880710ad-110c-42a4-a174-ab1b99a7ebeb:3305:1876092510074752:0@lo:400:kworker.0 00000100:00100000:0.0:1789181490.177535:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181490.177599:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510074752 00000100:00100000:0.0:1789181490.177606:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510074752 00000100:00100000:0.0:1789181490.177654:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1789181490.177663:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:3305:x1876092510074752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181490.177721:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:3305:x1876092510074752:12345-0@lo:400:kworker.0 Request processed in 59us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181490.177727:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1789181490.177775:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1baadd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:880710ad-110c-42a4-a174-ab1b99a7ebeb:3305:1876092510074752:0@lo:400:kworker.0 00000100:00080000:0.0:1789181490.177815:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789181490.177844:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1789181490.177854:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c0268700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876092510075008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181490.177893:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c0268700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876092510075008:12345-0@lo:400:kworker.0 Request processed in 42us (2698us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181490.177899:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1789181490.177951:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1baadea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1876092510075008:0@lo:400:kworker.0 00000100:00100000:2.0:1789181490.179172:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789181490.179186:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1baadf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876092510075392:0@lo:400:kworker.0 00000100:00100000:2.0:1789181490.179244:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181490.179293:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510075392 00000100:00100000:2.0:1789181490.179300:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510075392 00000100:00100000:2.0:1789181490.179379:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789181490.179389:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1baadea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876092510075392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181490.179448:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1baadea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876092510075392:12345-0@lo:400:kworker.0 Request processed in 61us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181490.179455:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:2.0:1789181490.179478:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789181490.179501:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1baadf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876092510075392:0@lo:400:kworker.0 00000100:00100000:2.0:1789181490.179541:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1baaddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1876092510075264:0@lo:400:kworker.0 00000100:00100000:2.0:1789181490.179568:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181490.179588:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789181490.179594:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1baaded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876092510075136:0@lo:400:kworker.0 00000100:00100000:2.0:1789181490.180053:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181490.180085:0:6894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510075136 00000100:00100000:2.0:1789181490.180090:0:6894:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510075136 00000100:00100000:2.0:1789181490.180123:0:6894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789181490.180130:0:6894:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1baadd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1876092510075136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181490.180166:0:6894:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1baadd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1876092510075136:12345-0@lo:400:kworker.0 Request processed in 36us (112us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181490.180172:0:6894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00080000:2.0:1789181490.180202:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc1baaded80 x1876092510075136/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789181506 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181490.180213:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1baaded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876092510075136:0@lo:400:kworker.0 00000100:00080000:2.0:1789181490.180243:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789181490.180254:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510075264 00000100:00100000:2.0:1789181490.180257:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510075264 00000100:00100000:2.0:1789181490.180286:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789181490.180293:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1baadf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876092510075264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181490.180353:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1baadf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876092510075264:12345-0@lo:400:kworker.0 Request processed in 36us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181490.180360:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789181490.180386:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1baaddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1876092510075264:0@lo:400:kworker.0 00000100:00080000:2.0:1789181490.180401:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789181490.180537:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1825a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876092510074880:12345-0@lo:400:kworker.0 Request processed in 5157us (5733us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181490.180545:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1789181490.183192:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1baadc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876092510074880:0@lo:400:kworker.0 00000100:00100000:0.0:1789181490.687054:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789181490.687090:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1825a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876092510075520:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789181490.687167:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181490.687780:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510075520 00000100:00100000:1.0:1789181490.687790:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510075520 00000100:00100000:1.0:1789181490.687865:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789181490.687876:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfa60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876092510075520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789181490.687916:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789181490.687976:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfa60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876092510075520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (810us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181490.687984:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789181490.688128:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1825a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876092510075520:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789181490.751302:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181491.066153:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181491.066461:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488017152 00000100:00100000:0.0:1789181491.066471:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488017152 00000100:00100000:0.0:1789181491.066552:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 32 00000100:00100000:0.0:1789181491.066566:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1825a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+5:10228:x1876092488017152:12345-192.168.204.32@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789181491.066602:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181491.066629:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891600/0x8f4f7840b2e413c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f033 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181491.066694:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e413ca lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181491.066710:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e413ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181491.066725:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e413ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789181491.066774:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789181491.066779:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789181491.066822:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e413ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181491.066848:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891600/0x8f4f7840b2e413c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f033 expref: 7 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181491.066867:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e413ca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f033 expref: 6 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181491.066875:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc18553a600) 00010000:00010000:0.0:1789181491.066879:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00000100:00080000:2.0:1789181491.067007:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789181491.067030:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc189890000, rc 0) 00000100:00100000:0.0:1789181491.067379:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1825a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+6:10228:x1876092488017152:12345-192.168.204.32@tcp:101:lhsmtool_posix.0 Request processed in 816us (1249us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181491.067399:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 32 00000100:00100000:3.0:1789181491.082922:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181491.084837:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488017280 00000100:00100000:2.0:1789181491.084853:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488017280 00000100:00100000:2.0:1789181491.084933:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 33 00000100:00100000:2.0:1789181491.084944:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1ba4a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+6:10229:x1876092488017280:12345-192.168.204.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789181491.084982:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181491.085005:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785a00/0x8f4f7840b2e413d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f03a expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181491.085069:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785400/0x8f4f7840b2e413d8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181491.085084:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785400/0x8f4f7840b2e413d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181491.085095:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785400/0x8f4f7840b2e413d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181491.085109:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785600/0x8f4f7840b2e413df lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181491.085116:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785600/0x8f4f7840b2e413df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181491.085122:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785600/0x8f4f7840b2e413df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181491.085409:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785800/0x8f4f7840b2e413e6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181491.085419:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785800/0x8f4f7840b2e413e6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181491.085427:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785800/0x8f4f7840b2e413e6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789181491.085456:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789181491.085465:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789181491.085492:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785800/0x8f4f7840b2e413e6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181491.085503:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785400/0x8f4f7840b2e413d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181491.085510:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785400/0x8f4f7840b2e413d8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181491.085517:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785400/0x8f4f7840b2e413d8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181491.085523:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1ba785400 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:2.0:1789181491.085527:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785400/0x8f4f7840b2e413d8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181491.085535:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785400/0x8f4f7840b2e413d8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181491.085546:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc18553a600) 00010000:00010000:2.0:1789181491.085549:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789181491.085553:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785400/0x8f4f7840b2e413d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181491.085559:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785400/0x8f4f7840b2e413d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181491.085570:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785600/0x8f4f7840b2e413df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181491.085576:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785600/0x8f4f7840b2e413df lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181491.085591:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785600/0x8f4f7840b2e413df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181491.085597:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1ba785600 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:2.0:1789181491.085600:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785600/0x8f4f7840b2e413df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181491.085606:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785600/0x8f4f7840b2e413df lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181491.085612:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9dc1995b7800) 00010000:00010000:2.0:1789181491.085615:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789181491.085617:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785600/0x8f4f7840b2e413df lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181491.085622:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785600/0x8f4f7840b2e413df lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181491.085654:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785a00/0x8f4f7840b2e413d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f03a expref: 8 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181491.085667:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785800/0x8f4f7840b2e413e6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f03a expref: 7 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181491.085674:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9dc1995b7600) 00010000:00010000:2.0:1789181491.085676:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789181491.085678:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1ba785800, rc 0) 00000100:00100000:2.0:1789181491.085749:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1ba4a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+7:10229:x1876092488017280:12345-192.168.204.32@tcp:101:lhsmtool_posix.0 Request processed in 807us (2836us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181491.085767:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 33 00000100:00100000:2.0:1789181491.090962:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181491.091570:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488017536 00000100:00100000:3.0:1789181491.091585:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488017536 00000100:00100000:3.0:1789181491.091654:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 34 00000100:00100000:3.0:1789181491.091666:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1baaddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+7:10229:x1876092488017536:12345-192.168.204.32@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789181491.091711:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181491.091731:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ec00/0x8f4f7840b2e413ed lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f041 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181491.091816:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e413f4 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181491.091833:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e413f4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181491.091845:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e413f4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181491.091894:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e413fb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181491.091902:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e413fb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181491.091909:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e413fb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181491.092300:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f600/0x8f4f7840b2e41402 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181491.092310:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f600/0x8f4f7840b2e41402 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181491.092316:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f600/0x8f4f7840b2e41402 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789181491.092326:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:3.0:1789181491.092524:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e413f4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181491.092533:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e413f4 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181491.092539:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e413f4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181491.092545:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1bfa1f000 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:3.0:1789181491.092550:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e413f4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181491.092558:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e413f4 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181491.092570:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9dc1995b7600) 00010000:00010000:3.0:1789181491.092574:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181491.092579:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e413f4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181491.092585:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e413f4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181491.092599:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e413fb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181491.092604:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e413fb lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181491.092610:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e413fb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181491.092625:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1bfa1f400 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:3.0:1789181491.092628:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e413fb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181491.092635:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e413fb lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181491.092643:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9dc192187e00) 00010000:00010000:3.0:1789181491.092645:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181491.092648:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e413fb lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181491.092654:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e413fb lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181491.095827:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ec00/0x8f4f7840b2e413ed lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f041 expref: 10 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181491.095921:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f600/0x8f4f7840b2e41402 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f041 expref: 9 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181491.095931:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9dc192187200) 00010000:00010000:3.0:1789181491.095935:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181491.095939:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1bfa1f600, rc 0) 00000100:00100000:3.0:1789181491.096017:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1baaddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+9:10229:x1876092488017536:12345-192.168.204.32@tcp:101:lhsmtool_posix.0 Request processed in 4353us (5063us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1789181491.096025:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 34 00000100:00100000:1.0:1789181491.106540:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181491.106643:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488017664 00000100:00100000:2.0:1789181491.106654:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488017664 00000100:00100000:2.0:1789181491.106719:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 35 00000100:00100000:2.0:1789181491.106731:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1825a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+9:10229:x1876092488017664:12345-192.168.204.32@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1789181491.106852:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1825a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+9:10229:x1876092488017664:12345-192.168.204.32@tcp:59:lhsmtool_posix.0 Request processed in 123us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181491.106859:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 35 00000001:00080000:3.0:1789181491.289636:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967309 is committed 00010000:00010000:0.0:1789181491.775350:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789181491.903111:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789181492.798524:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181492.888233:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181492.888588:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488017792 00000100:00100000:2.0:1789181492.888598:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488017792 00000100:00100000:2.0:1789181492.888695:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 36 00000100:00100000:2.0:1789181492.888706:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfa61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+8:10272:x1876092488017792:12345-192.168.204.32@tcp:101:lfs.0 00010000:00010000:2.0:1789181492.888726:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181492.888745:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785a00/0x8f4f7840b2e41410 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f048 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181492.888803:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e41417 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181492.888816:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e41417 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181492.888826:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e41417 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181492.888839:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785e00/0x8f4f7840b2e4141e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181492.888852:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785e00/0x8f4f7840b2e4141e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181492.888858:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785e00/0x8f4f7840b2e4141e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181492.889037:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e41417 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181492.889045:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e41417 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181492.889052:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e41417 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181492.889057:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1ba785c00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:2.0:1789181492.889063:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e41417 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181492.889070:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e41417 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181492.889083:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc18553a600) 00010000:00010000:2.0:1789181492.889086:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789181492.889090:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e41417 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181492.889096:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e41417 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181492.889106:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785e00/0x8f4f7840b2e4141e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181492.889116:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785e00/0x8f4f7840b2e4141e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181492.889122:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785e00/0x8f4f7840b2e4141e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181492.889128:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1ba785e00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:2.0:1789181492.889131:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785e00/0x8f4f7840b2e4141e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181492.889136:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785e00/0x8f4f7840b2e4141e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181492.889144:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9dc1995b7100) 00010000:00010000:2.0:1789181492.889146:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789181492.889149:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785e00/0x8f4f7840b2e4141e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181492.889155:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785e00/0x8f4f7840b2e4141e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181492.889301:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785a00/0x8f4f7840b2e41410 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f048 expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181492.889311:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc18553a600) 00010000:00010000:2.0:1789181492.889314:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789181492.889317:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785a00/0x8f4f7840b2e41410 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f048 expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181492.889325:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1ba785a00, rc 0) 00000100:00100000:2.0:1789181492.889558:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfa61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+8:10272:x1876092488017792:12345-192.168.204.32@tcp:101:lfs.0 Request processed in 853us (1334us total) trans 0 rc 301/301 00000100:00100000:2.0:1789181492.889566:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 36 00000100:00100000:2.0:1789181492.894920:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181492.894992:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488018048 00000100:00100000:0.0:1789181492.895003:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488018048 00000100:00100000:0.0:1789181492.895060:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 37 00000100:00100000:0.0:1789181492.895070:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1baaded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+8:10272:x1876092488018048:12345-192.168.204.32@tcp:36:lfs.0 00010000:00010000:0.0:1789181492.895147:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789181492.895183:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e413ca lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f033 expref: 8 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181492.895200:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc18553a600) 00010000:00010000:0.0:1789181492.895219:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789181492.895446:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891400/0x8f4f7840b2e41425 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181492.895462:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891400/0x8f4f7840b2e41425 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181492.895472:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891400/0x8f4f7840b2e41425 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181492.895485:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890a00/0x8f4f7840b2e4142c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181492.895492:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890a00/0x8f4f7840b2e4142c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181492.895500:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890a00/0x8f4f7840b2e4142c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789181492.896399:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1789181492.896412:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891400/0x8f4f7840b2e41425 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181492.896421:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891400/0x8f4f7840b2e41425 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181492.896428:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891400/0x8f4f7840b2e41425 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181492.896434:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc189891400 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:0.0:1789181492.896439:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891400/0x8f4f7840b2e41425 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181492.896447:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891400/0x8f4f7840b2e41425 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181492.896459:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc18553a800) 00010000:00010000:0.0:1789181492.896462:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789181492.896465:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891400/0x8f4f7840b2e41425 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181492.896471:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891400/0x8f4f7840b2e41425 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789181492.896485:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bd328a72 reply state 00000000dbdcdcab transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890a00/0x8f4f7840b2e4142c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181492.896493:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789181492.896591:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1baaded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+9:10272:x1876092488018048:12345-192.168.204.32@tcp:36:lfs.0 Request processed in 1521us (1680us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1789181492.896606:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 37 00010000:00010000:3.0:1789181492.905187:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890a00/0x8f4f7840b2e4142c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181492.905205:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890a00/0x8f4f7840b2e4142c lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181492.905214:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890a00/0x8f4f7840b2e4142c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181492.905220:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc189890a00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:3.0:1789181492.905225:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890a00/0x8f4f7840b2e4142c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181492.905233:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890a00/0x8f4f7840b2e4142c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181492.905250:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9dc18553ac00) 00010000:00010000:3.0:1789181492.905253:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181492.905258:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890a00/0x8f4f7840b2e4142c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181492.905264:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890a00/0x8f4f7840b2e4142c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181492.983580:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181492.983711:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488018176 00000100:00100000:3.0:1789181492.983723:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488018176 00000100:00100000:3.0:1789181492.983786:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 38 00000100:00100000:3.0:1789181492.983798:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1baadc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+8:10280:x1876092488018176:12345-192.168.204.32@tcp:101:lctl.0 00010000:00010000:3.0:1789181492.983822:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181492.983845:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e41433 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f04f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181492.983928:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ec00/0x8f4f7840b2e4143a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181492.983941:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ec00/0x8f4f7840b2e4143a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181492.983952:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ec00/0x8f4f7840b2e4143a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789181492.983987:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789181492.983990:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789181492.984025:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ec00/0x8f4f7840b2e4143a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181492.984049:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e41433 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f04f expref: 10 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181492.984068:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ec00/0x8f4f7840b2e4143a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f04f expref: 9 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181492.984076:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc192187000) 00010000:00010000:3.0:1789181492.984079:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789181492.984082:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1bfa1ec00, rc 0) 00000100:00100000:3.0:1789181492.984895:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1baadc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+9:10280:x1876092488018176:12345-192.168.204.32@tcp:101:lctl.0 Request processed in 1096us (1322us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181492.984904:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 38 00000100:00100000:0.0:1789181493.030256:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181493.030976:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488018304 00000100:00100000:2.0:1789181493.030988:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488018304 00000100:00100000:2.0:1789181493.031070:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 39 00000100:00100000:2.0:1789181493.031082:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+9:10286:x1876092488018304:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:2.0:1789181493.031103:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181493.031134:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785a00/0x8f4f7840b2e41441 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f056 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181493.031209:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785e00/0x8f4f7840b2e41448 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181493.031223:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785e00/0x8f4f7840b2e41448 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181493.031234:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785e00/0x8f4f7840b2e41448 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181493.031248:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e4144f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181493.031255:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e4144f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181493.031261:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e4144f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181493.031418:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784c00/0x8f4f7840b2e41456 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181493.031427:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784c00/0x8f4f7840b2e41456 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181493.031435:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784c00/0x8f4f7840b2e41456 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789181493.031462:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1789181493.031466:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789181493.031503:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784c00/0x8f4f7840b2e41456 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181493.031516:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785e00/0x8f4f7840b2e41448 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181493.031522:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785e00/0x8f4f7840b2e41448 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181493.031529:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785e00/0x8f4f7840b2e41448 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181493.031536:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1ba785e00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:2.0:1789181493.031540:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785e00/0x8f4f7840b2e41448 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181493.031548:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785e00/0x8f4f7840b2e41448 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181493.031560:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc192187000) 00010000:00010000:2.0:1789181493.031569:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789181493.031575:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785e00/0x8f4f7840b2e41448 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181493.031582:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785e00/0x8f4f7840b2e41448 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181493.031596:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e4144f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181493.031602:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e4144f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181493.031609:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e4144f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181493.031613:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1ba785c00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:2.0:1789181493.031616:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e4144f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181493.031621:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e4144f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181493.031628:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9dc1995b7100) 00010000:00010000:2.0:1789181493.031632:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789181493.031635:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e4144f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181493.031641:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e4144f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181493.031671:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785a00/0x8f4f7840b2e41441 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f056 expref: 11 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181493.031697:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784c00/0x8f4f7840b2e41456 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f056 expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181493.031704:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9dc1995b7200) 00010000:00010000:2.0:1789181493.031706:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789181493.031708:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1ba784c00, rc 0) 00000100:00080000:0.0:1789181493.031957:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789181493.031998:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+10:10286:x1876092488018304:12345-192.168.204.32@tcp:101:bash.0 Request processed in 917us (1750us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181493.032078:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 39 00000100:00100000:0.0:1789181493.039688:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181493.039758:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488018560 00000100:00100000:2.0:1789181493.039768:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488018560 00000100:00100000:2.0:1789181493.039825:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 40 00000100:00100000:2.0:1789181493.039834:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+10:10286:x1876092488018560:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:2.0:1789181493.039854:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181493.039874:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784000/0x8f4f7840b2e4145d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f05d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181493.039995:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785600/0x8f4f7840b2e41464 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181493.040010:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785600/0x8f4f7840b2e41464 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181493.040022:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785600/0x8f4f7840b2e41464 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181493.040037:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785400/0x8f4f7840b2e4146b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181493.040045:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785400/0x8f4f7840b2e4146b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181493.040067:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785400/0x8f4f7840b2e4146b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789181493.040650:0:5843:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:2.0:1789181493.040817:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784200/0x8f4f7840b2e41472 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181493.040827:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784200/0x8f4f7840b2e41472 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181493.040836:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784200/0x8f4f7840b2e41472 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181493.040866:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785600/0x8f4f7840b2e41464 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181493.040874:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785600/0x8f4f7840b2e41464 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181493.040881:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785600/0x8f4f7840b2e41464 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181493.040887:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1ba785600 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:2.0:1789181493.040891:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785600/0x8f4f7840b2e41464 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181493.040899:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785600/0x8f4f7840b2e41464 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181493.040911:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9dc1995b7200) 00010000:00010000:2.0:1789181493.040913:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789181493.040925:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785600/0x8f4f7840b2e41464 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181493.040931:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785600/0x8f4f7840b2e41464 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789181493.040947:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c2ec0863 reply state 00000000eaf49394 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785400/0x8f4f7840b2e4146b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181493.040955:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789181493.040987:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784000/0x8f4f7840b2e4145d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f05d expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181493.041000:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784200/0x8f4f7840b2e41472 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f05d expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181493.041008:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9dc1995b7700) 00010000:00010000:2.0:1789181493.041010:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789181493.041013:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1ba784200, rc 0) 00000100:00100000:2.0:1789181493.041080:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+13:10286:x1876092488018560:12345-192.168.204.32@tcp:101:bash.0 Request processed in 1247us (1403us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1789181493.041087:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 40 00010000:00010000:1.0:1789181493.046462:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785400/0x8f4f7840b2e4146b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181493.046483:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785400/0x8f4f7840b2e4146b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181493.046492:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785400/0x8f4f7840b2e4146b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181493.046499:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1ba785400 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:1.0:1789181493.046504:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785400/0x8f4f7840b2e4146b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181493.046513:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785400/0x8f4f7840b2e4146b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181493.046530:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9dc1995b7e00) 00010000:00010000:1.0:1789181493.046533:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789181493.046538:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785400/0x8f4f7840b2e4146b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181493.046545:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785400/0x8f4f7840b2e4146b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181493.052025:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181493.052759:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488018688 00000100:00100000:2.0:1789181493.052770:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488018688 00000100:00100000:2.0:1789181493.052833:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 20 00000100:00100000:2.0:1789181493.052842:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfa2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2350:x1876092488018688:12345-192.168.204.32@tcp:8:bash.0 00010000:00080000:2.0:1789181493.052875:0:6693:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 5971a429-48ca-4c07-88a3-fa58102a53bc@192.168.204.32@tcp t0 exp 0000000000000000 cur 385 last 0 00000020:00000080:2.0:1789181493.052909:0:6693:0:(genops.c:1384:class_connect()) connect: client 5971a429-48ca-4c07-88a3-fa58102a53bc, cookie 0x8f4f7840b2e41480 00002000:00100000:2.0:1789181493.052919:0:6693:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 5971a429-48ca-4c07-88a3-fa58102a53bc/ffff9dc1c0241000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789181493.052955:0:6693:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789181493.053219:0:6693:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789181493.053251:0:6693:0:(import.c:65:import_set_state_nolock()) ffff9dc1c0240800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789181493.053359:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfa2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+6:2350:x1876092488018688:12345-192.168.204.32@tcp:8:bash.0 Request processed in 485us (1312us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181493.053368:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 20 00000100:00100000:2.0:1789181493.057471:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181493.057989:0:6894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488018816 00000100:00100000:0.0:1789181493.058000:0:6894:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488018816 00000100:00100000:0.0:1789181493.058133:0:6894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 21 00000100:00100000:0.0:1789181493.058144:0:6894:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b67ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+6:0:x1876092488018816:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:0.0:1789181493.058163:0:6894:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181493.058207:0:6894:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a9d1a45/0x8f4f7840b2e41487 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f064 expref: -99 pid: 6894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789181493.058237:0:6894:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789181493.058257:0:6894:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=385s v=(0 0) 00010000:00010000:0.0:1789181493.058261:0:6894:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789181493.058272:0:6894:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a9d1a45/0x8f4f7840b2e41487 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f064 expref: 7 pid: 6894 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181493.058292:0:6894:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007a9d1a45/0x8f4f7840b2e41487 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f064 expref: 7 pid: 6894 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181493.058306:0:6894:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc189890e00, rc 0) 00000100:00100000:0.0:1789181493.058398:0:6894:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b67ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+7:0:x1876092488018816:12345-192.168.204.32@tcp:101:bash.0 Request processed in 255us (937us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181493.058405:0:6894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 21 00000100:00080000:2.0:1789181493.058958:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789181493.061365:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181493.061644:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488018944 00000100:00100000:2.0:1789181493.061654:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488018944 00000100:00100000:2.0:1789181493.061709:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 22 00000100:00100000:2.0:1789181493.061720:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1825a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+7:10286:x1876092488018944:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:2.0:1789181493.061737:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181493.061758:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf918e38/0x8f4f7840b2e4148e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f06b expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181493.061786:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007a9d1a45/0x8f4f7840b2e41487 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f064 expref: 8 pid: 6894 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181493.061794:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789181493.061799:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789181493.061804:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf918e38/0x8f4f7840b2e4148e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f06b expref: 8 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181493.061837:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007a9d1a45/0x8f4f7840b2e41487 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f064 expref: 8 pid: 6894 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181493.061869:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007a9d1a45/0x8f4f7840b2e41487 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f064 expref: 8 pid: 6894 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181493.061884:0:6693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b67a8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6693:1876092510075648:192.168.204.32@tcp:104: 00000100:00100000:2.0:1789181493.061974:0:6693:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1899d3000 going to sleep for 11 seconds 00000100:00100000:3.0:1789181493.064893:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181493.064963:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488019072 00000100:00100000:0.0:1789181493.064971:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488019072 00010000:00010000:0.0:1789181493.065010:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007a9d1a45/0x8f4f7840b2e41487 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f064 expref: 9 pid: 6894 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181493.065056:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 35 00000100:00100000:0.0:1789181493.065065:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1ba4a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+9:2353:x1876092488019072:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789181493.065081:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789181493.065109:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007a9d1a45/0x8f4f7840b2e41487 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f064 expref: 9 pid: 6894 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181493.065123:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007a9d1a45/0x8f4f7840b2e41487 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f064 expref: 9 pid: 6894 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181493.065146:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789181493.065151:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789181493.065160:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cf918e38/0x8f4f7840b2e4148e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f06b expref: 9 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181493.065176:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a9d1a45/0x8f4f7840b2e41487 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f064 expref: 9 pid: 6894 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181493.065182:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf918e38/0x8f4f7840b2e4148e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f06b expref: 9 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181493.065190:0:6693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b67a8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6693:1876092510075648:192.168.204.32@tcp:104: 00010000:00010000:0.0:1789181493.065216:0:5827:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000cf918e38/0x8f4f7840b2e4148e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f06b expref: 8 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181493.065224:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cf918e38/0x8f4f7840b2e4148e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f06b expref: 8 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181493.065229:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfa2f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5827:1876092510075776:192.168.204.32@tcp:105: 00010000:00010000:2.0:1789181493.065233:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1ba784000, rc 0) 00000100:00100000:2.0:1789181493.065293:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1825a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+8:10286:x1876092488018944:12345-192.168.204.32@tcp:101:bash.0 Request processed in 3570us (3965us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181493.065300:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 22 00000100:00100000:0.0:1789181493.066174:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1c03e7900 going to sleep for 11 seconds 00000100:00100000:0.0:1789181493.069176:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfa2f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5827:1876092510075776:192.168.204.32@tcp:105: 00010000:00010000:0.0:1789181493.069205:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789181493.069262:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1ba4a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+7:2353:x1876092488019072:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 4198us (4377us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181493.069272:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 35 00000100:00100000:1.0:1789181493.071598:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181493.071762:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488019328 00000100:00100000:3.0:1789181493.071772:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488019328 00000100:00100000:3.0:1789181493.071831:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 6 00000100:00100000:3.0:1789181493.071842:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6af0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+12:10286:x1876092488019328:12345-192.168.204.32@tcp:35:bash.0 00000100:00100000:3.0:1789181493.072844:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6af0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+13:10286:x1876092488019328:12345-192.168.204.32@tcp:35:bash.0 Request processed in 998us (1249us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1789181493.072855:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 6 00000100:00100000:2.0:1789181493.168397:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181493.168500:0:6887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488019584 00000100:00100000:1.0:1789181493.168511:0:6887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488019584 00000100:00100000:1.0:1789181493.168573:0:6887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 41 00000100:00100000:1.0:1789181493.168584:0:6887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b67a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+13:10296:x1876092488019584:12345-192.168.204.32@tcp:101:lfs.0 00010000:00010000:1.0:1789181493.168613:0:6887:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181493.168633:0:6887:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c2044400/0x8f4f7840b2e41495 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f072 expref: -99 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789181493.168726:0:6887:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1789181493.168865:0:6887:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c2044400/0x8f4f7840b2e41495 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f072 expref: 15 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181493.168880:0:6887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc192187000) 00010000:00010000:1.0:1789181493.168883:0:6887:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789181493.168888:0:6887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c2044400/0x8f4f7840b2e41495 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f072 expref: 15 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181493.168915:0:6887:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1c2044400, rc 0) 00000100:00100000:1.0:1789181493.168997:0:6887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b67a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+14:10296:x1876092488019584:12345-192.168.204.32@tcp:101:lfs.0 Request processed in 415us (609us total) trans 4294967313 rc 301/301 00000100:00100000:1.0:1789181493.169004:0:6887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 41 00000100:00100000:1.0:1789181493.174369:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181493.174520:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488019840 00000100:00100000:0.0:1789181493.174541:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488019840 00000100:00100000:0.0:1789181493.174600:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 7 00000100:00100000:0.0:1789181493.174611:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b66de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+14:10296:x1876092488019840:12345-192.168.204.32@tcp:35:lfs.0 00000100:00100000:0.0:1789181493.175150:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b66de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+15:10296:x1876092488019840:12345-192.168.204.32@tcp:35:lfs.0 Request processed in 538us (790us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1789181493.175159:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 7 00000100:00100000:0.0:1789181493.250518:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b67aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510075904:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789181493.250595:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181493.252088:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510075904 00000100:00100000:3.0:1789181493.252108:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510075904 00000100:00100000:3.0:1789181493.252226:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789181493.252238:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfa2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510075904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789181493.252265:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1789181493.252366:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789181493.254945:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfa2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510075904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2699us (4339us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181493.254962:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789181493.258831:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b67aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510075904:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789181493.267871:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181493.267985:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488019968 00000100:00100000:2.0:1789181493.267997:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488019968 00000100:00100000:2.0:1789181493.268060:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 42 00000100:00100000:2.0:1789181493.268072:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfcf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+15:10302:x1876092488019968:12345-192.168.204.32@tcp:101:lfs.0 00010000:00010000:2.0:1789181493.268098:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181493.268123:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785a00/0x8f4f7840b2e414a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f079 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181493.268223:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e414aa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181493.268239:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e414aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181493.268252:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e414aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789181493.268289:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1789181493.268292:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789181493.268312:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e414aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181493.268433:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785a00/0x8f4f7840b2e414a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f079 expref: 17 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181493.268452:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e414aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f079 expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181493.268460:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9dc1995b7200) 00010000:00010000:2.0:1789181493.268463:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789181493.268467:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1ba785c00, rc 0) 00000100:00100000:2.0:1789181493.268610:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfcf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+16:10302:x1876092488019968:12345-192.168.204.32@tcp:101:lfs.0 Request processed in 540us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181493.268618:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 42 00000100:00100000:0.0:1789181493.279824:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181493.280443:0:6887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488020224 00000100:00100000:1.0:1789181493.280466:0:6887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488020224 00000100:00100000:1.0:1789181493.280532:0:6887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 43 00000100:00100000:1.0:1789181493.280544:0:6887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfcf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+16:10302:x1876092488020224:12345-192.168.204.32@tcp:101:lfs.0 00010000:00010000:1.0:1789181493.280565:0:6887:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181493.280588:0:6887:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c2045400/0x8f4f7840b2e414b1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f080 expref: -99 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181493.280711:0:6887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c2044400/0x8f4f7840b2e414b8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181493.281285:0:6887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c2044400/0x8f4f7840b2e414b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181493.281301:0:6887:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c2044400/0x8f4f7840b2e414b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789181493.281316:0:6887:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1789181493.281504:0:6887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c2045400/0x8f4f7840b2e414b1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f080 expref: 19 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181493.281525:0:6887:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c2044400/0x8f4f7840b2e414b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f080 expref: 18 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181493.281535:0:6887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9dc1995b7700) 00010000:00010000:1.0:1789181493.281539:0:6887:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789181493.281543:0:6887:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1c2044400, rc 0) 00000100:00100000:1.0:1789181493.281603:0:6887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfcf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+18:10302:x1876092488020224:12345-192.168.204.32@tcp:101:lfs.0 Request processed in 1062us (1788us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1789181493.281611:0:6887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 43 00000100:00100000:1.0:1789181493.285077:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181493.285120:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181493.285270:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488020352 00000100:00100000:3.0:1789181493.285281:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488020352 00000100:00100000:3.0:1789181493.285451:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2 00000100:00100000:3.0:1789181493.285463:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c0659880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+18:2353:x1876092488020352:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789181493.285480:0:6707:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789181493.285504:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c2044400/0x8f4f7840b2e414b8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f080 expref: 18 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181493.285544:0:6707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9dc1995b7700) 00010000:00010000:3.0:1789181493.285548:0:6707:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789181493.285609:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c0659880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+17:2353:x1876092488020352:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 150us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181493.285616:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2 00000100:00100000:2.0:1789181493.288995:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488020608 00000100:00100000:2.0:1789181493.289016:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488020608 00000100:00100000:2.0:1789181493.289144:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 44 00000100:00100000:2.0:1789181493.289155:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c0659180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+17:10302:x1876092488020608:12345-192.168.204.32@tcp:101:lfs.0 00010000:00010000:2.0:1789181493.289192:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181493.289214:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785a00/0x8f4f7840b2e414c6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f087 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181493.289320:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785e00/0x8f4f7840b2e414cd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181493.289365:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785e00/0x8f4f7840b2e414cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181493.289381:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785e00/0x8f4f7840b2e414cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789181493.289394:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789181493.289538:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785a00/0x8f4f7840b2e414c6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f087 expref: 20 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181493.289556:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785e00/0x8f4f7840b2e414cd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f087 expref: 19 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181493.289565:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9dc1995b7700) 00010000:00010000:2.0:1789181493.289568:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789181493.289572:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1ba785e00, rc 0) 00000100:00100000:2.0:1789181493.289852:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c0659180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+19:10302:x1876092488020608:12345-192.168.204.32@tcp:101:lfs.0 Request processed in 697us (4730us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1789181493.289860:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 44 00000100:00100000:1.0:1789181493.300294:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181493.300378:0:6894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488020736 00000100:00100000:0.0:1789181493.300389:0:6894:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488020736 00000100:00100000:0.0:1789181493.300493:0:6894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 23 00000100:00100000:0.0:1789181493.300506:0:6894:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c0658700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+7:2353:x1876092488020736:12345-192.168.204.32@tcp:1:lfs.0 00010000:00010000:0.0:1789181493.300558:0:6894:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086b918f1/0x8f4f7840b2e414db lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181493.300598:0:6894:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cf918e38/0x8f4f7840b2e4148e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f06b expref: 7 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181493.300606:0:6894:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789181493.300610:0:6894:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789181493.300615:0:6894:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000086b918f1/0x8f4f7840b2e414db lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181493.300701:0:6894:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cf918e38/0x8f4f7840b2e4148e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f06b expref: 7 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181493.300717:0:6894:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cf918e38/0x8f4f7840b2e4148e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f06b expref: 7 pid: 6693 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181493.300733:0:6894:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfcf7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:6894:1876092510076032:192.168.204.32@tcp:104: 00000100:00100000:0.0:1789181493.300835:0:6894:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1c03e7900 going to sleep for 11 seconds 00000100:00100000:1.0:1789181493.304983:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181493.305268:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488020864 00000100:00100000:2.0:1789181493.305295:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488020864 00002000:00100000:2.0:1789181493.305402:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff9dc1c0659500 x1876092488020864/t0(0) o4->5971a429-48ca-4c07-88a3-fa58102a53bc@192.168.204.32@tcp:624/0 lens 504/0 e 0 to 0 dl 1789181504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789181493.305413:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9dc1c0659500 with x1876092488020864 ext(0->12) 00010000:00010000:2.0:1789181493.305560:0:6697:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000cf918e38/0x8f4f7840b2e4148e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f06b expref: 8 pid: 6693 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181493.305581:0:6697:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000cf918e38/0x8f4f7840b2e4148e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f06b expref: 8 pid: 6693 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789181493.305589:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9dc1c0659500 00000100:00100000:2.0:1789181493.305615:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 0 00000100:00100000:2.0:1789181493.305626:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c0659500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+8:2354:x1876092488020864:12345-192.168.204.32@tcp:4:lfs.0 00000100:00100000:0.0:1789181493.309284:0:6894:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfcf7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:6894:1876092510076032:192.168.204.32@tcp:104: 00010000:00010000:0.0:1789181493.309314:0:6894:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000086b918f1/0x8f4f7840b2e414db lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:1.0:1789181493.389484:0:6718:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5971a429-48ca-4c07-88a3-fa58102a53bc 00000001:00080000:2.0:1789181493.481986:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:0.0:1789181493.482149:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c0659500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+7:2354:x1876092488020864:12345-192.168.204.32@tcp:4:lfs.0 Request processed in 176518us (177172us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1789181493.482178:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 0 00002000:00100000:0.0:1789181493.482884:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff9dc1c0659500 x1876092488020864/t4294967299(0) o4->5971a429-48ca-4c07-88a3-fa58102a53bc@192.168.204.32@tcp:624/0 lens 504/448 e 0 to 0 dl 1789181504 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789181493.482908:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9dc1c0659500 with x1876092488020864 ext(0->12) 00010000:00010000:0.0:1789181493.482921:0:6697:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000cf918e38/0x8f4f7840b2e4148e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f06b expref: 7 pid: 6693 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181493.482940:0:6697:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000cf918e38/0x8f4f7840b2e4148e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f06b expref: 7 pid: 6693 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789181493.482949:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9dc1c0659500 00000100:00100000:1.0:1789181493.489323:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181493.489508:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488020992 00000100:00100000:0.0:1789181493.489519:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488020992 00010000:00010000:0.0:1789181493.489567:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cf918e38/0x8f4f7840b2e4148e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f06b expref: 7 pid: 6693 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181493.489611:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 36 00000100:00100000:0.0:1789181493.489623:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c065a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+7:2352:x1876092488020992:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789181493.489647:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789181493.489674:0:5829:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1789181493.489677:0:5829:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1789181494 00002000:00010000:0.0:1789181493.489679:0:5829:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1789181494 00002000:00010000:0.0:1789181493.489682:0:5829:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1789181494 00002000:00010000:0.0:1789181493.489684:0:5829:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:0.0:1789181493.489691:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cf918e38/0x8f4f7840b2e4148e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f06b expref: 7 pid: 6693 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181493.489706:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cf918e38/0x8f4f7840b2e4148e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f06b expref: 7 pid: 6693 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181493.489757:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf918e38/0x8f4f7840b2e4148e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f06b expref: 7 pid: 6693 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181493.489775:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789181493.489780:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789181493.489785:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000086b918f1/0x8f4f7840b2e414db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181493.489795:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000086b918f1/0x8f4f7840b2e414db lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181493.489834:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789181493.489892:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c065a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+6:2352:x1876092488020992:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 272us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181493.489900:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 36 00010000:00010000:2.0:1789181493.490029:0:6894:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000086b918f1/0x8f4f7840b2e414db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181493.490039:0:6894:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000086b918f1/0x8f4f7840b2e414db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181493.490064:0:6894:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086b918f1/0x8f4f7840b2e414db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181493.490072:0:6894:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000086b918f1/0x8f4f7840b2e414db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181493.490092:0:6894:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000086b918f1/0x8f4f7840b2e414db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181493.490098:0:6894:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc189890c00 already unused, calling callback (ffffffffc152f9b0) 00010000:00010000:2.0:1789181493.490103:0:6894:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000086b918f1/0x8f4f7840b2e414db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181493.490112:0:6894:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000086b918f1/0x8f4f7840b2e414db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181493.490127:0:6894:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000086b918f1/0x8f4f7840b2e414db lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181493.490136:0:6894:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000086b918f1/0x8f4f7840b2e414db lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181493.490205:0:6894:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c0658700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+5:2353:x1876092488020736:12345-192.168.204.32@tcp:1:lfs.0 Request processed in 189691us (189911us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181493.490214:0:6894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 23 00000100:00100000:2.0:1789181493.497261:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181493.497372:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488021248 00000100:00100000:3.0:1789181493.497384:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488021248 00000100:00100000:3.0:1789181493.497430:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 8 00000100:00100000:3.0:1789181493.497441:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b67a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+19:10302:x1876092488021248:12345-192.168.204.32@tcp:35:lfs.0 00000004:00010000:3.0:1789181493.497504:0:5846:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785e00/0x8f4f7840b2e414cd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f087 expref: 19 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789181493.497804:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:3.0:1789181493.497858:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:3.0:1789181493.498470:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:3.0:1789181493.498534:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e414e2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181493.498550:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784200/0x8f4f7840b2e41472 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f05d expref: 23 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181493.498561:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e414e2 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181493.498596:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784200/0x8f4f7840b2e41472 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f05d expref: 23 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181493.498623:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784200/0x8f4f7840b2e41472 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f05d expref: 23 pid: 5843 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181493.498639:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1ba4a9880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5846:1876092510076160:192.168.204.32@tcp:104: 00000100:00100000:3.0:1789181493.498746:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc19c38da80 going to sleep for 11 seconds 00000100:00100000:1.0:1789181493.501832:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181493.502506:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1ba4a9880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5846:1876092510076160:192.168.204.32@tcp:104: 00010000:00010000:3.0:1789181493.502536:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e414e2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181493.503854:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488021376 00000100:00100000:0.0:1789181493.503867:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488021376 00010000:00010000:0.0:1789181493.503910:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784200/0x8f4f7840b2e41472 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f05d expref: 24 pid: 5843 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181493.503955:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 37 00000100:00100000:0.0:1789181493.503966:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c065b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+24:2354:x1876092488021376:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789181493.503980:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789181493.503987:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784200/0x8f4f7840b2e41472 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f05d expref: 24 pid: 5843 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181493.504018:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784200/0x8f4f7840b2e41472 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f05d expref: 24 pid: 5843 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181493.504042:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784200/0x8f4f7840b2e41472 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f05d expref: 24 pid: 5843 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181493.504058:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9dc1995b7700) 00010000:00010000:0.0:1789181493.504063:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e414e2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181493.504071:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e414e2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181493.504079:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e414e2 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181493.505753:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789181493.505842:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c065b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+23:2354:x1876092488021376:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 1872us (4014us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181493.505855:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 37 00010000:00010000:2.0:1789181493.508437:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e414e2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181493.508455:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e414e2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789181493.508841:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:3.0:1789181493.509203:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:3.0:1789181493.509321:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1ba4a9880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1876092510076288:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789181493.509407:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181493.509446:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc19c38d540 going to sleep for 11 seconds 00000100:00100000:2.0:1789181493.510172:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510076288 00000100:00100000:2.0:1789181493.510183:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510076288 00000100:00100000:2.0:1789181493.510237:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789181493.510247:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1ba4a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1876092510076288:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789181493.510374:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1ba4a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1876092510076288:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 128us (966us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181493.510381:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789181493.510488:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1ba4a9880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1876092510076288:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1789181493.512782:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:3.0:1789181493.512887:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1ba4a9880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1876092510076416:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789181493.512949:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181493.513595:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc19c38da80 going to sleep for 11 seconds 00000100:00100000:1.0:1789181493.513717:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510076416 00000100:00100000:1.0:1789181493.513726:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510076416 00000100:00100000:1.0:1789181493.513833:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789181493.513845:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1ba4a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5846:x1876092510076416:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789181493.514173:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1ba4a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5846:x1876092510076416:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 330us (1223us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1789181493.514182:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789181493.514254:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1ba4a9880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1876092510076416:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1789181493.514317:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:3.0:1789181493.514406:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e414e2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181493.514417:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e414e2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181493.514439:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e414e2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181493.514446:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1bfa1f400 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:3.0:1789181493.514450:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e414e2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181493.514458:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e414e2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181493.514474:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9dc1995b7700) 00010000:00010000:3.0:1789181493.514477:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1789181493.514482:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e414e2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181493.514489:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e414e2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789181493.514717:0:5846:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1789181493.514930:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:3.0:1789181493.514943:0:5846:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 385771611738ns, next at 386771609628ns, rc = 0 00000001:00080000:3.0:1789181493.514950:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:3.0:1789181493.514985:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9dc1995b7700) 00010000:00010000:3.0:1789181493.514988:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789181493.515004:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785e00/0x8f4f7840b2e414cd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f087 expref: 27 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181493.515130:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b67a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+26:10302:x1876092488021248:12345-192.168.204.32@tcp:35:lfs.0 Request processed in 17691us (17878us total) trans 4294967325 rc 0/0 00000100:00100000:3.0:1789181493.515149:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 8 00000020:00080000:3.0:1789181493.515154:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1789181493.522905:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181493.523002:0:6887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488021504 00000100:00100000:0.0:1789181493.523012:0:6887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488021504 00000100:00100000:0.0:1789181493.523068:0:6887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 45 00000100:00100000:0.0:1789181493.523078:0:6887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c0658000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+26:10302:x1876092488021504:12345-192.168.204.32@tcp:101:lfs.0 00010000:00010000:0.0:1789181493.523102:0:6887:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181493.523121:0:6887:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891200/0x8f4f7840b2e414e9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f08e expref: -99 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181493.523212:0:6887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891200/0x8f4f7840b2e414e9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f08e expref: 27 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181493.523226:0:6887:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891200/0x8f4f7840b2e414e9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f08e expref: 27 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181493.523242:0:6887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9dc18553a200) 00010000:00010000:0.0:1789181493.523245:0:6887:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789181493.523248:0:6887:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc189891200, rc 0) 00000100:00100000:0.0:1789181493.523299:0:6887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c0658000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+27:10302:x1876092488021504:12345-192.168.204.32@tcp:101:lfs.0 Request processed in 223us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181493.523305:0:6887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 45 00000100:00100000:0.0:1789181493.526861:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181493.526948:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488021760 00000100:00100000:1.0:1789181493.526959:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488021760 00000100:00100000:1.0:1789181493.527015:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9 00000100:00100000:1.0:1789181493.527027:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19928e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+27:10302:x1876092488021760:12345-192.168.204.32@tcp:35:lfs.0 00000100:00100000:1.0:1789181493.527745:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19928e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+28:10302:x1876092488021760:12345-192.168.204.32@tcp:35:lfs.0 Request processed in 715us (885us total) trans 4294967326 rc 0/0 00000100:00100000:1.0:1789181493.527754:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9 00000100:00100000:1.0:1789181493.618547:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181493.618638:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488022016 00000100:00100000:0.0:1789181493.618649:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488022016 00000100:00100000:0.0:1789181493.618709:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 46 00000100:00100000:0.0:1789181493.618730:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c065aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+28:10312:x1876092488022016:12345-192.168.204.32@tcp:101:lfs.0 00010000:00010000:0.0:1789181493.618757:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181493.618777:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891a00/0x8f4f7840b2e414f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f095 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789181493.618865:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1789181493.618980:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891a00/0x8f4f7840b2e414f0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f095 expref: 30 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181493.618993:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc192187000) 00010000:00010000:0.0:1789181493.619010:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789181493.619017:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891a00/0x8f4f7840b2e414f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f095 expref: 30 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181493.619032:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc189891a00, rc 0) 00000100:00100000:0.0:1789181493.619099:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c065aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+29:10312:x1876092488022016:12345-192.168.204.32@tcp:101:lfs.0 Request processed in 371us (562us total) trans 4294967327 rc 301/301 00000100:00100000:0.0:1789181493.619114:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 46 00000100:00100000:3.0:1789181493.622411:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181493.622721:0:6887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488022144 00000100:00100000:0.0:1789181493.622732:0:6887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488022144 00000100:00100000:0.0:1789181493.622793:0:6887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 47 00000100:00100000:0.0:1789181493.622804:0:6887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1ba4a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+29:10312:x1876092488022144:12345-192.168.204.32@tcp:34:lfs.0 00010000:00010000:0.0:1789181493.622885:0:6887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891800/0x8f4f7840b2e414fe lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181493.622902:0:6887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891800/0x8f4f7840b2e414fe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181493.622913:0:6887:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891800/0x8f4f7840b2e414fe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181493.622930:0:6887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890200/0x8f4f7840b2e41505 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181493.622937:0:6887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890200/0x8f4f7840b2e41505 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181493.622944:0:6887:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890200/0x8f4f7840b2e41505 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181493.623035:0:6887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891600/0x8f4f7840b2e4150c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181493.623056:0:6887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891600/0x8f4f7840b2e4150c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181493.623063:0:6887:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891600/0x8f4f7840b2e4150c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789181493.623119:0:6887:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891600/0x8f4f7840b2e4150c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181493.623133:0:6887:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891800/0x8f4f7840b2e414fe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181493.623140:0:6887:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891800/0x8f4f7840b2e414fe lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181493.623146:0:6887:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891800/0x8f4f7840b2e414fe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181493.623161:0:6887:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc189891800 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:0.0:1789181493.623165:0:6887:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891800/0x8f4f7840b2e414fe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181493.623173:0:6887:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891800/0x8f4f7840b2e414fe lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181493.623183:0:6887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9dc1995b7200) 00010000:00010000:0.0:1789181493.623186:0:6887:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789181493.623199:0:6887:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891800/0x8f4f7840b2e414fe lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181493.623205:0:6887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891800/0x8f4f7840b2e414fe lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181493.623228:0:6887:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890200/0x8f4f7840b2e41505 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181493.623235:0:6887:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890200/0x8f4f7840b2e41505 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181493.623241:0:6887:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890200/0x8f4f7840b2e41505 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181493.623246:0:6887:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc189890200 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:0.0:1789181493.623250:0:6887:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890200/0x8f4f7840b2e41505 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181493.623256:0:6887:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890200/0x8f4f7840b2e41505 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181493.623264:0:6887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9dc18553a400) 00010000:00010000:0.0:1789181493.623266:0:6887:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789181493.623269:0:6887:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890200/0x8f4f7840b2e41505 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181493.623274:0:6887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890200/0x8f4f7840b2e41505 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181493.623288:0:6887:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891600/0x8f4f7840b2e4150c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181493.623293:0:6887:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891600/0x8f4f7840b2e4150c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181493.623298:0:6887:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891600/0x8f4f7840b2e4150c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181493.623309:0:6887:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc189891600 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:0.0:1789181493.623312:0:6887:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891600/0x8f4f7840b2e4150c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181493.623318:0:6887:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891600/0x8f4f7840b2e4150c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181493.623327:0:6887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9dc18553a200) 00010000:00010000:0.0:1789181493.623366:0:6887:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789181493.623370:0:6887:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891600/0x8f4f7840b2e4150c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181493.623376:0:6887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891600/0x8f4f7840b2e4150c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181493.623458:0:6887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1ba4a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+29:10312:x1876092488022144:12345-192.168.204.32@tcp:34:lfs.0 Request processed in 655us (1055us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181493.623465:0:6887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 47 00000100:00100000:1.0:1789181493.629966:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181493.630051:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488022400 00000100:00100000:3.0:1789181493.630062:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488022400 00000100:00100000:3.0:1789181493.630125:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 10 00000100:00100000:3.0:1789181493.630135:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c065b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+29:10312:x1876092488022400:12345-192.168.204.32@tcp:35:lfs.0 00000100:00100000:3.0:1789181493.630418:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c065b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+30:10312:x1876092488022400:12345-192.168.204.32@tcp:35:lfs.0 Request processed in 284us (461us total) trans 4294967328 rc 0/0 00000100:00100000:3.0:1789181493.630426:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 10 00000100:00100000:2.0:1789181493.660478:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181493.660572:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488022656 00000100:00100000:0.0:1789181493.660582:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488022656 00000100:00100000:0.0:1789181493.660644:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 48 00000100:00100000:0.0:1789181493.660656:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b67abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+30:10315:x1876092488022656:12345-192.168.204.32@tcp:101:lfs.0 00010000:00010000:0.0:1789181493.660682:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181493.660702:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891600/0x8f4f7840b2e41513 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f09c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181493.660784:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890200/0x8f4f7840b2e4151a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181493.660815:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890200/0x8f4f7840b2e4151a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181493.660827:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890200/0x8f4f7840b2e4151a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181493.660843:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891800/0x8f4f7840b2e41521 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181493.660850:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891800/0x8f4f7840b2e41521 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181493.660857:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891800/0x8f4f7840b2e41521 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181493.660970:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890c00/0x8f4f7840b2e41528 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181493.660978:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890c00/0x8f4f7840b2e41528 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181493.660986:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890c00/0x8f4f7840b2e41528 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789181493.660995:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1789181493.661085:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890200/0x8f4f7840b2e4151a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181493.661092:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890200/0x8f4f7840b2e4151a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181493.661098:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890200/0x8f4f7840b2e4151a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181493.661111:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc189890200 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:0.0:1789181493.661115:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890200/0x8f4f7840b2e4151a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181493.661123:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890200/0x8f4f7840b2e4151a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181493.661135:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9dc1995b7200) 00010000:00010000:0.0:1789181493.661138:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789181493.661143:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890200/0x8f4f7840b2e4151a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181493.661150:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890200/0x8f4f7840b2e4151a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181493.661182:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891800/0x8f4f7840b2e41521 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181493.661391:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891800/0x8f4f7840b2e41521 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181493.661400:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891800/0x8f4f7840b2e41521 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181493.661405:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc189891800 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:0.0:1789181493.661408:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891800/0x8f4f7840b2e41521 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181493.661414:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891800/0x8f4f7840b2e41521 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181493.661435:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9dc18553a400) 00010000:00010000:0.0:1789181493.661438:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789181493.661441:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891800/0x8f4f7840b2e41521 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181493.661448:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891800/0x8f4f7840b2e41521 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181493.661494:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891600/0x8f4f7840b2e41513 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f09c expref: 33 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181493.661508:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890c00/0x8f4f7840b2e41528 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f09c expref: 32 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181493.661515:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9dc18553a200) 00010000:00010000:0.0:1789181493.661517:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789181493.661519:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc189890c00, rc 0) 00000100:00100000:0.0:1789181493.661593:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b67abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+32:10315:x1876092488022656:12345-192.168.204.32@tcp:101:lfs.0 Request processed in 938us (1124us total) trans 4294967329 rc 0/0 00000100:00100000:0.0:1789181493.661601:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 48 00000100:00100000:0.0:1789181493.664464:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181493.664925:0:6887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488022784 00000100:00100000:1.0:1789181493.664936:0:6887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488022784 00000100:00100000:1.0:1789181493.665036:0:6887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 49 00000100:00100000:1.0:1789181493.665058:0:6887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfcf7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+32:10315:x1876092488022784:12345-192.168.204.32@tcp:54:lfs.0 00010000:00010000:1.0:1789181493.665145:0:6887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c2044400/0x8f4f7840b2e41536 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181493.665173:0:6887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c2044400/0x8f4f7840b2e41536 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181493.665185:0:6887:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c2044400/0x8f4f7840b2e41536 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181493.665319:0:6887:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c2044400/0x8f4f7840b2e41536 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181493.665327:0:6887:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c2044400/0x8f4f7840b2e41536 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181493.666940:0:6887:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c2044400/0x8f4f7840b2e41536 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181493.666948:0:6887:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1c2044400 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:1.0:1789181493.666952:0:6887:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c2044400/0x8f4f7840b2e41536 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181493.666962:0:6887:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c2044400/0x8f4f7840b2e41536 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181493.666978:0:6887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9dc18553a200) 00010000:00010000:1.0:1789181493.666981:0:6887:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789181493.666986:0:6887:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c2044400/0x8f4f7840b2e41536 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181493.666993:0:6887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c2044400/0x8f4f7840b2e41536 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181493.667132:0:6887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfcf7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+32:10315:x1876092488022784:12345-192.168.204.32@tcp:54:lfs.0 Request processed in 2074us (2674us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181493.667142:0:6887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 49 00000100:00100000:2.0:1789181493.669563:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181493.669653:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488023040 00000100:00100000:3.0:1789181493.669662:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488023040 00000100:00100000:3.0:1789181493.669718:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 11 00000100:00100000:3.0:1789181493.669729:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b67a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+32:10315:x1876092488023040:12345-192.168.204.32@tcp:35:lfs.0 00000100:00100000:3.0:1789181493.669963:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b67a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+33:10315:x1876092488023040:12345-192.168.204.32@tcp:35:lfs.0 Request processed in 236us (408us total) trans 4294967330 rc 0/0 00000100:00100000:3.0:1789181493.669971:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 11 00010000:00010000:0.0:1789181493.822835:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181493.909982:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181493.910092:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488023296 00000100:00100000:0.0:1789181493.910104:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488023296 00000100:00100000:0.0:1789181493.910173:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 50 00000100:00100000:0.0:1789181493.910184:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b67a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+33:10346:x1876092488023296:12345-192.168.204.32@tcp:101:cat.0 00010000:00010000:0.0:1789181493.910209:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181493.910252:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891600/0x8f4f7840b2e4153d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f0a3 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181493.910375:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891800/0x8f4f7840b2e41544 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181493.910388:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891800/0x8f4f7840b2e41544 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181493.910398:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891800/0x8f4f7840b2e41544 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789181493.910408:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1789181493.910544:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891600/0x8f4f7840b2e4153d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f0a3 expref: 36 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181493.910564:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891800/0x8f4f7840b2e41544 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f0a3 expref: 35 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181493.910573:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9dc18553a200) 00010000:00010000:0.0:1789181493.910576:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789181493.910580:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc189891800, rc 0) 00000100:00100000:0.0:1789181493.910639:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b67a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+35:10346:x1876092488023296:12345-192.168.204.32@tcp:101:cat.0 Request processed in 457us (668us total) trans 4294967331 rc 0/0 00000100:00100000:0.0:1789181493.910646:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 50 00000100:00100000:2.0:1789181493.914546:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181493.914625:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488023424 00000100:00100000:0.0:1789181493.914635:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488023424 00000100:00100000:0.0:1789181493.914738:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 3 00000100:00100000:0.0:1789181493.914750:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1960f3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+35:2351:x1876092488023424:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789181493.914782:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789181493.914805:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891800/0x8f4f7840b2e41544 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f0a3 expref: 35 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181493.914837:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9dc18553a200) 00010000:00010000:0.0:1789181493.914845:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789181493.914870:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181493.914896:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1960f3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+34:2351:x1876092488023424:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 149us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181493.914904:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 3 00000100:00100000:3.0:1789181493.914922:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488023680 00000100:00100000:3.0:1789181493.914926:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488023680 00000100:00100000:3.0:1789181493.915541:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 12 00000100:00100000:3.0:1789181493.915554:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b67a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+34:10346:x1876092488023680:12345-192.168.204.32@tcp:35:cat.0 00000100:00100000:3.0:1789181493.916190:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b67a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+35:10346:x1876092488023680:12345-192.168.204.32@tcp:35:cat.0 Request processed in 636us (1315us total) trans 4294967332 rc 0/0 00000100:00100000:3.0:1789181493.916199:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 12 00000100:00100000:2.0:1789181493.974017:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181493.974117:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488023936 00000100:00100000:3.0:1789181493.974140:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488023936 00000100:00100000:3.0:1789181493.974212:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 51 00000100:00100000:3.0:1789181493.974222:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b67a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+35:10352:x1876092488023936:12345-192.168.204.32@tcp:101:dd.0 00010000:00010000:3.0:1789181493.974255:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181493.974258:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789181493.974283:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e414aa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f079 expref: 35 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181493.974302:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9dc1995b7200) 00010000:00010000:3.0:1789181493.974308:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789181493.974322:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e41552 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f0aa expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181493.974647:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e41559 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181493.974662:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890c00/0x8f4f7840b2e41528 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f09c expref: 35 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181493.974671:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e41559 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181493.974702:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890c00/0x8f4f7840b2e41528 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f09c expref: 35 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181493.974900:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890c00/0x8f4f7840b2e41528 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f09c expref: 35 pid: 5842 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181493.974916:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1ba4aa680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1876092510076544:192.168.204.32@tcp:104: 00000100:00100000:3.0:1789181493.975055:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc19c38da80 going to sleep for 11 seconds 00000100:00100000:2.0:1789181493.978474:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181493.978662:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1ba4aa680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1876092510076544:192.168.204.32@tcp:104: 00010000:00010000:3.0:1789181493.978691:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e41559 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181493.978871:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488024064 00000100:00100000:0.0:1789181493.978881:0:8456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488024064 00010000:00010000:0.0:1789181493.978918:0:8456:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890c00/0x8f4f7840b2e41528 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f09c expref: 36 pid: 5842 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181493.978955:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 38 00000100:00100000:0.0:1789181493.978965:0:8456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b67a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5971a429-48ca-4c07-88a3-fa58102a53bc+36:2354:x1876092488024064:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789181493.978980:0:8456:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789181493.978986:0:8456:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890c00/0x8f4f7840b2e41528 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f09c expref: 36 pid: 5842 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181493.978997:0:8456:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890c00/0x8f4f7840b2e41528 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f09c expref: 36 pid: 5842 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181493.979022:0:8456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890c00/0x8f4f7840b2e41528 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f09c expref: 36 pid: 5842 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181493.979040:0:8456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9dc18553a200) 00010000:00010000:0.0:1789181493.979061:0:8456:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e41559 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181493.979070:0:8456:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e41559 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181493.979077:0:8456:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e41559 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181493.979114:0:8456:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789181493.979177:0:8456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b67a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5971a429-48ca-4c07-88a3-fa58102a53bc+35:2354:x1876092488024064:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 213us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181493.979193:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 38 00010000:00010000:2.0:1789181493.979259:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e41559 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181493.979267:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e41559 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789181493.979287:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789181493.979485:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e41552 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f0aa expref: 36 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181493.979503:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e41559 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f0aa expref: 35 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181493.979522:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9dc18553a200) 00010000:00010000:2.0:1789181493.979525:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789181493.979528:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1bfa1f000, rc 0) 00000100:00100000:2.0:1789181493.979554:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b67a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+35:10352:x1876092488023936:12345-192.168.204.32@tcp:101:dd.0 Request processed in 5332us (5547us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1789181493.979564:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 51 00000100:00100000:0.0:1789181493.982611:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181493.982695:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488024320 00000100:00100000:2.0:1789181493.982711:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488024320 00000100:00100000:2.0:1789181493.982761:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 52 00000100:00100000:2.0:1789181493.982770:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfcf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+35:10352:x1876092488024320:12345-192.168.204.32@tcp:36:dd.0 00010000:00010000:2.0:1789181493.983026:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784000/0x8f4f7840b2e41567 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181493.983042:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784000/0x8f4f7840b2e41567 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181493.983055:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784000/0x8f4f7840b2e41567 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789181493.983116:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:2.0:1789181493.983142:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f460f2cd reply state 00000000531d6e95 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784000/0x8f4f7840b2e41567 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181493.983161:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789181493.983507:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfcf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+38:10352:x1876092488024320:12345-192.168.204.32@tcp:36:dd.0 Request processed in 737us (903us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1789181493.983515:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 52 00000020:00080000:2.0:1789181493.983533:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789181493.985207:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784000/0x8f4f7840b2e41567 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181493.985231:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784000/0x8f4f7840b2e41567 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181493.985239:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784000/0x8f4f7840b2e41567 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181493.985245:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1ba784000 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:3.0:1789181493.985250:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784000/0x8f4f7840b2e41567 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181493.985258:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784000/0x8f4f7840b2e41567 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181493.985273:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9dc18553a200) 00010000:00010000:3.0:1789181493.985276:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181493.985282:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784000/0x8f4f7840b2e41567 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181493.985287:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784000/0x8f4f7840b2e41567 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181494.269803:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181494.270449:0:6887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488024448 00000100:00100000:1.0:1789181494.270461:0:6887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488024448 00000100:00100000:1.0:1789181494.270526:0:6887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 53 00000100:00100000:1.0:1789181494.270538:0:6887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfcf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+37:10366:x1876092488024448:12345-192.168.204.32@tcp:101:stat.0 00010000:00010000:1.0:1789181494.270561:0:6887:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181494.270585:0:6887:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c2044400/0x8f4f7840b2e4156e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f0b1 expref: -99 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181494.270652:0:6887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c2045400/0x8f4f7840b2e41575 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181494.270666:0:6887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c2045400/0x8f4f7840b2e41575 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181494.270676:0:6887:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c2045400/0x8f4f7840b2e41575 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181494.270691:0:6887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c2045c00/0x8f4f7840b2e4157c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181494.270699:0:6887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c2045c00/0x8f4f7840b2e4157c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181494.270705:0:6887:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c2045c00/0x8f4f7840b2e4157c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181494.270812:0:6887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b600/0x8f4f7840b2e41583 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181494.270823:0:6887:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e41559 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f0aa expref: 38 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181494.270831:0:6887:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b600/0x8f4f7840b2e41583 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181494.270862:0:6887:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e41559 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f0aa expref: 38 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181494.270876:0:6887:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e41559 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f0aa expref: 38 pid: 5844 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181494.270888:0:6887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c065a300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6887:1876092510076672:192.168.204.32@tcp:104: 00000100:00100000:1.0:1789181494.272401:0:6887:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc190660c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789181494.276670:0:6887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c065a300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6887:1876092510076672:192.168.204.32@tcp:104: 00010000:00010000:1.0:1789181494.276707:0:6887:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b600/0x8f4f7840b2e41583 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181494.277424:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181494.277519:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488024704 00000100:00100000:3.0:1789181494.277528:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488024704 00000100:00100000:3.0:1789181494.277613:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 13 00000100:00100000:3.0:1789181494.277625:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfcf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+39:5591:x1876092488024704:12345-192.168.204.32@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789181494.278444:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfcf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+40:5591:x1876092488024704:12345-192.168.204.32@tcp:35:ldlm_bl.0 Request processed in 817us (1021us total) trans 4294967336 rc 0/0 00000100:00100000:3.0:1789181494.278454:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 13 00000100:00100000:0.0:1789181494.284117:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181494.284403:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488024832 00000100:00100000:1.0:1789181494.284414:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488024832 00010000:00010000:1.0:1789181494.284460:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e41559 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f0aa expref: 40 pid: 5844 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181494.284503:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 39 00000100:00100000:1.0:1789181494.284532:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfcf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+40:2353:x1876092488024832:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789181494.284548:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789181494.284555:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e41559 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f0aa expref: 40 pid: 5844 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181494.284569:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e41559 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f0aa expref: 40 pid: 5844 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181494.284593:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e41559 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f0aa expref: 40 pid: 5844 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181494.284611:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9dc18553a200) 00010000:00010000:1.0:1789181494.284616:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b600/0x8f4f7840b2e41583 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181494.284626:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b600/0x8f4f7840b2e41583 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181494.284633:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b600/0x8f4f7840b2e41583 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181494.284670:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789181494.284720:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfcf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+39:2353:x1876092488024832:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 190us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181494.284728:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 39 00010000:00010000:3.0:1789181494.285186:0:6887:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b600/0x8f4f7840b2e41583 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.285196:0:6887:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b600/0x8f4f7840b2e41583 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789181494.285252:0:6887:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1789181494.285257:0:6887:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789181494.285298:0:6887:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b600/0x8f4f7840b2e41583 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.285311:0:6887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b600/0x8f4f7840b2e41583 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.285320:0:6887:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c2045400/0x8f4f7840b2e41575 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.285326:0:6887:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c2045400/0x8f4f7840b2e41575 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.285375:0:6887:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c2045400/0x8f4f7840b2e41575 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.285380:0:6887:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1c2045400 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:3.0:1789181494.285384:0:6887:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c2045400/0x8f4f7840b2e41575 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.285404:0:6887:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c2045400/0x8f4f7840b2e41575 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.285415:0:6887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9dc1995b7200) 00010000:00010000:3.0:1789181494.285418:0:6887:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181494.285422:0:6887:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c2045400/0x8f4f7840b2e41575 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.285427:0:6887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c2045400/0x8f4f7840b2e41575 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.285440:0:6887:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c2045c00/0x8f4f7840b2e4157c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.285446:0:6887:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c2045c00/0x8f4f7840b2e4157c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.285452:0:6887:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c2045c00/0x8f4f7840b2e4157c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.285457:0:6887:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1c2045c00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:3.0:1789181494.285460:0:6887:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c2045c00/0x8f4f7840b2e4157c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.285466:0:6887:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c2045c00/0x8f4f7840b2e4157c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.285472:0:6887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9dc18a6c2300) 00010000:00010000:3.0:1789181494.285475:0:6887:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181494.285477:0:6887:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c2045c00/0x8f4f7840b2e4157c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.285492:0:6887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c2045c00/0x8f4f7840b2e4157c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.285534:0:6887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c2044400/0x8f4f7840b2e4156e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f0b1 expref: 39 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.285562:0:6887:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b600/0x8f4f7840b2e41583 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f0b1 expref: 38 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.285569:0:6887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9dc18553a200) 00010000:00010000:3.0:1789181494.285571:0:6887:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789181494.285574:0:6887:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc18151b600, rc 0) 00000100:00100000:3.0:1789181494.285616:0:6887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfcf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+38:10366:x1876092488024448:12345-192.168.204.32@tcp:101:stat.0 Request processed in 15081us (15823us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181494.285624:0:6887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 53 00000100:00100000:0.0:1789181494.357395:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181494.357448:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181494.357534:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181494.357628:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488025088 00000100:00100000:2.0:1789181494.357638:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488025088 00000100:00100000:1.0:1789181494.357730:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488024960 00000100:00100000:1.0:1789181494.357735:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488024960 00000100:00100000:1.0:1789181494.357770:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 286 00000100:00100000:1.0:1789181494.357779:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:975a0591-a8f7-4a74-9f93-a5aa77f2315c+13:2354:x1876092488024960:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:1.0:1789181494.357859:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:975a0591-a8f7-4a74-9f93-a5aa77f2315c+13:2354:x1876092488024960:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 81us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181494.357867:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 286 00000100:00100000:3.0:1789181494.358355:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488025216 00000100:00100000:3.0:1789181494.358360:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488025216 00000100:00100000:3.0:1789181494.358413:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 133 00000100:00080000:1.0:1789181494.358452:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789181494.358481:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfcf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7badad21-a177-49b1-a2af-7b11e28c02ce+5:2354:x1876092488025216:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:3.0:1789181494.358521:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfcf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7badad21-a177-49b1-a2af-7b11e28c02ce+5:2354:x1876092488025216:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 101us (987us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181494.358528:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 133 00000100:00100000:0.0:1789181494.358685:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 75 00000100:00100000:0.0:1789181494.358697:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfcf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+5:2354:x1876092488025088:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:0.0:1789181494.358726:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfcf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+5:2354:x1876092488025088:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 34us (1346us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181494.358732:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 75 00000100:00100000:1.0:1789181494.378479:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181494.378686:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488025472 00000100:00100000:0.0:1789181494.378696:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488025472 00000100:00100000:0.0:1789181494.378831:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 54 00000100:00100000:0.0:1789181494.378843:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c065a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+38:10372:x1876092488025472:12345-192.168.204.32@tcp:36:truncate.0 00010000:00010000:0.0:1789181494.378932:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789181494.378959:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b600/0x8f4f7840b2e41583 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f0b1 expref: 38 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181494.378984:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9dc18553a200) 00010000:00010000:0.0:1789181494.378989:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789181494.382088:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891600/0x8f4f7840b2e4158a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181494.382113:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891600/0x8f4f7840b2e4158a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181494.382133:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891600/0x8f4f7840b2e4158a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789181494.382230:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:0.0:1789181494.382278:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000137cfc04 reply state 00000000d3b5708b transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891600/0x8f4f7840b2e4158a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181494.382288:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789181494.382465:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c065a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+40:10372:x1876092488025472:12345-192.168.204.32@tcp:36:truncate.0 Request processed in 3620us (3992us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1789181494.382476:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 54 00000020:00080000:0.0:1789181494.382483:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789181494.387519:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891600/0x8f4f7840b2e4158a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181494.387543:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891600/0x8f4f7840b2e4158a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181494.387551:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891600/0x8f4f7840b2e4158a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181494.387557:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc189891600 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:1.0:1789181494.387561:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891600/0x8f4f7840b2e4158a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181494.387569:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891600/0x8f4f7840b2e4158a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181494.387586:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9dc18553a200) 00010000:00010000:1.0:1789181494.387590:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789181494.387595:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891600/0x8f4f7840b2e4158a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181494.387602:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891600/0x8f4f7840b2e4158a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181494.537551:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181494.537913:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488025600 00000100:00100000:3.0:1789181494.537934:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488025600 00000100:00100000:3.0:1789181494.538005:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 55 00000100:00100000:3.0:1789181494.538017:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c0658e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+39:10386:x1876092488025600:12345-192.168.204.32@tcp:101:stat.0 00010000:00010000:3.0:1789181494.538057:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181494.538079:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e41591 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f0b8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.538157:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e41598 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.538180:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e41598 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.538192:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e41598 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.538209:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e4159f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.538215:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e4159f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.538222:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e4159f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.538308:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e415a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.538317:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e415a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.538325:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e415a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789181494.538392:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:3.0:1789181494.538403:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789181494.538427:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e415a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.538440:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e415a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.538448:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e41598 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.538455:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e41598 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.538461:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e41598 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.538467:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1bfa1fc00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:3.0:1789181494.538472:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e41598 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.538479:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e41598 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.538492:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9dc1995b7200) 00010000:00010000:3.0:1789181494.538494:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181494.538498:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e41598 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.538504:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e41598 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.538518:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e4159f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.538546:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e4159f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.538553:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e4159f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.538558:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1bfa1f000 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:3.0:1789181494.538561:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e4159f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.538567:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e4159f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.538574:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9dc192187800) 00010000:00010000:3.0:1789181494.538577:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181494.538579:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e4159f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.538585:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e4159f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.538618:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e41591 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f0b8 expref: 41 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.538630:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e415a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f0b8 expref: 40 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.538637:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9dc18553a200) 00010000:00010000:3.0:1789181494.538639:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789181494.538647:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1bfa1f400, rc 0) 00000100:00100000:3.0:1789181494.538726:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c0658e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+40:10386:x1876092488025600:12345-192.168.204.32@tcp:101:stat.0 Request processed in 712us (1195us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181494.538733:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 55 00000100:00100000:2.0:1789181494.619882:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181494.620194:0:6887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488025856 00000100:00100000:3.0:1789181494.620205:0:6887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488025856 00000100:00100000:3.0:1789181494.620279:0:6887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 56 00000100:00100000:3.0:1789181494.620289:0:6887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b67a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+40:10396:x1876092488025856:12345-192.168.204.32@tcp:101:lfs.0 00010000:00010000:3.0:1789181494.620312:0:6887:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181494.620375:0:6887:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e415ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f0bf expref: -99 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789181494.620468:0:6887:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1789181494.620881:0:6887:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e415ad lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f0bf expref: 42 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.620898:0:6887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc192187000) 00010000:00010000:3.0:1789181494.620901:0:6887:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789181494.620906:0:6887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e415ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f0bf expref: 42 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.620923:0:6887:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1bfa1fa00, rc 0) 00000100:00100000:3.0:1789181494.620977:0:6887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b67a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+41:10396:x1876092488025856:12345-192.168.204.32@tcp:101:lfs.0 Request processed in 690us (1109us total) trans 4294967339 rc 301/301 00000100:00100000:3.0:1789181494.620984:0:6887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 56 00000100:00100000:1.0:1789181494.628753:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181494.631593:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488026112 00000100:00100000:3.0:1789181494.631610:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488026112 00000100:00100000:2.0:1789181494.631828:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 14 00000100:00100000:2.0:1789181494.631840:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c065b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+41:10396:x1876092488026112:12345-192.168.204.32@tcp:35:lfs.0 00000100:00100000:2.0:1789181494.632105:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c065b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+42:10396:x1876092488026112:12345-192.168.204.32@tcp:35:lfs.0 Request processed in 266us (3358us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1789181494.632113:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 14 00000100:00100000:1.0:1789181494.686962:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181494.687201:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488026368 00000100:00100000:3.0:1789181494.687230:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488026368 00000100:00100000:3.0:1789181494.687300:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 57 00000100:00100000:3.0:1789181494.687311:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c0658a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+42:10402:x1876092488026368:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:3.0:1789181494.687367:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181494.687388:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e415bb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f0c6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.687484:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e415c2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.687500:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e415a6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f0b8 expref: 43 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.687509:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e415c2 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.687543:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e415a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f0b8 expref: 43 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.687557:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e415a6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f0b8 expref: 43 pid: 5842 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181494.687573:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1ba4aa680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1876092510076800:192.168.204.32@tcp:104: 00000100:00100000:3.0:1789181494.687865:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc19c38da80 going to sleep for 11 seconds 00000100:00100000:0.0:1789181494.692838:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181494.692954:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1ba4aa680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1876092510076800:192.168.204.32@tcp:104: 00010000:00010000:3.0:1789181494.692987:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e415c2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181494.693064:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488026496 00000100:00100000:2.0:1789181494.693071:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488026496 00010000:00010000:2.0:1789181494.693117:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e415a6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f0b8 expref: 44 pid: 5842 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181494.693161:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 40 00000100:00100000:2.0:1789181494.693171:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c36f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+44:2353:x1876092488026496:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789181494.693194:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789181494.693201:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e415a6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f0b8 expref: 44 pid: 5842 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181494.693211:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e415a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f0b8 expref: 44 pid: 5842 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181494.693231:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e415a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f0b8 expref: 44 pid: 5842 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181494.693245:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9dc18553a200) 00010000:00010000:2.0:1789181494.693263:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e415c2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181494.693271:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e415c2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181494.693278:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e415c2 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181494.693302:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789181494.693390:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c36f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+43:2353:x1876092488026496:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 220us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181494.693397:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 40 00010000:00010000:3.0:1789181494.693493:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e415c2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.693505:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e415c2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789181494.693522:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:3.0:1789181494.693661:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e415bb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f0c6 expref: 44 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.693676:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e415c2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f0c6 expref: 43 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.693683:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9dc18553a200) 00010000:00010000:3.0:1789181494.693686:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789181494.693689:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1bfa1f000, rc 0) 00000100:00100000:3.0:1789181494.693715:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c0658a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+43:10402:x1876092488026368:12345-192.168.204.32@tcp:101:bash.0 Request processed in 6407us (6763us total) trans 4294967341 rc 0/0 00000100:00100000:3.0:1789181494.693722:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 57 00000100:00100000:1.0:1789181494.700616:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181494.700716:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488026752 00000100:00100000:0.0:1789181494.700726:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488026752 00000100:00100000:0.0:1789181494.700785:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 58 00000100:00100000:0.0:1789181494.700796:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c065ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+43:10402:x1876092488026752:12345-192.168.204.32@tcp:36:bash.0 00010000:00010000:0.0:1789181494.701083:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890600/0x8f4f7840b2e415d0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181494.701099:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890600/0x8f4f7840b2e415d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181494.701110:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890600/0x8f4f7840b2e415d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789181494.701170:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:0.0:1789181494.701207:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e6c1c346 reply state 000000006510e3a8 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890600/0x8f4f7840b2e415d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181494.701215:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789181494.701311:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c065ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+46:10402:x1876092488026752:12345-192.168.204.32@tcp:36:bash.0 Request processed in 517us (706us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1789181494.701319:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 58 00000020:00080000:0.0:1789181494.701323:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789181494.702804:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890600/0x8f4f7840b2e415d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.702819:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890600/0x8f4f7840b2e415d0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.702826:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890600/0x8f4f7840b2e415d0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.702832:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc189890600 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:3.0:1789181494.702837:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890600/0x8f4f7840b2e415d0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.702861:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890600/0x8f4f7840b2e415d0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.702877:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9dc18553a200) 00010000:00010000:3.0:1789181494.702881:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181494.702887:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890600/0x8f4f7840b2e415d0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.702893:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890600/0x8f4f7840b2e415d0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181494.707994:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181494.708093:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488026880 00000100:00100000:0.0:1789181494.708103:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488026880 00000100:00100000:0.0:1789181494.708192:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 59 00000100:00100000:0.0:1789181494.708203:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c0659c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+45:10402:x1876092488026880:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:0.0:1789181494.708226:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181494.708247:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890400/0x8f4f7840b2e415d7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f0cd expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181494.708738:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890e00/0x8f4f7840b2e415de lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181494.708755:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e415c2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f0c6 expref: 46 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181494.708780:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890e00/0x8f4f7840b2e415de lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181494.708816:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e415c2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f0c6 expref: 46 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181494.708831:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e415c2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f0c6 expref: 46 pid: 5842 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181494.708847:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc19c36ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1876092510076928:192.168.204.32@tcp:104: 00000100:00100000:0.0:1789181494.708940:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc187dfd3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789181494.713863:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc19c36ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1876092510076928:192.168.204.32@tcp:104: 00010000:00010000:0.0:1789181494.713905:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890e00/0x8f4f7840b2e415de lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181494.714603:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181494.714778:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488027008 00000100:00100000:3.0:1789181494.714787:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488027008 00010000:00010000:3.0:1789181494.714826:0:6707:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e415c2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f0c6 expref: 47 pid: 5842 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181494.714913:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 41 00000100:00100000:3.0:1789181494.714924:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c065bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+47:2354:x1876092488027008:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789181494.714940:0:6707:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789181494.714948:0:6707:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e415c2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f0c6 expref: 47 pid: 5842 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.714963:0:6707:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e415c2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f0c6 expref: 47 pid: 5842 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.714986:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e415c2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f0c6 expref: 47 pid: 5842 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.715027:0:6707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9dc18553a200) 00010000:00010000:3.0:1789181494.715035:0:6707:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890e00/0x8f4f7840b2e415de lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.715046:0:6707:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890e00/0x8f4f7840b2e415de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.715055:0:6707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890e00/0x8f4f7840b2e415de lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.715092:0:6707:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789181494.715159:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c065bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+46:2354:x1876092488027008:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 236us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181494.715167:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 41 00010000:00010000:2.0:1789181494.715231:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890e00/0x8f4f7840b2e415de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181494.715240:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890e00/0x8f4f7840b2e415de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789181494.715285:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789181494.715290:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789181494.715310:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890e00/0x8f4f7840b2e415de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181494.715367:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890400/0x8f4f7840b2e415d7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f0cd expref: 46 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181494.715384:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890e00/0x8f4f7840b2e415de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f0cd expref: 45 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181494.715392:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9dc18553a200) 00010000:00010000:2.0:1789181494.715401:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789181494.715404:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc189890e00, rc 0) 00000100:00100000:2.0:1789181494.715428:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c0659c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+45:10402:x1876092488026880:12345-192.168.204.32@tcp:101:bash.0 Request processed in 7228us (7447us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181494.715436:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 59 00000100:00100000:2.0:1789181494.718422:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181494.718501:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488027264 00000100:00100000:3.0:1789181494.718510:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488027264 00000100:00100000:3.0:1789181494.718567:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 15 00000100:00100000:3.0:1789181494.718580:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19928f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+45:10402:x1876092488027264:12345-192.168.204.32@tcp:35:bash.0 00000100:00100000:0.0:1789181494.719035:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19928f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+46:10402:x1876092488027264:12345-192.168.204.32@tcp:35:bash.0 Request processed in 458us (622us total) trans 4294967344 rc 0/0 00000100:00100000:0.0:1789181494.719044:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 15 00000100:00100000:0.0:1789181494.808262:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181494.808367:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488027520 00000100:00100000:2.0:1789181494.808377:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488027520 00000100:00100000:2.0:1789181494.808434:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 60 00000100:00100000:2.0:1789181494.808445:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c36ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+46:10412:x1876092488027520:12345-192.168.204.32@tcp:101:lfs.0 00010000:00010000:2.0:1789181494.808687:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181494.808710:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785600/0x8f4f7840b2e415e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f0d4 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789181494.808824:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1789181494.808935:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785600/0x8f4f7840b2e415e5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f0d4 expref: 48 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181494.808949:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc192187000) 00010000:00010000:2.0:1789181494.808953:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789181494.808958:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785600/0x8f4f7840b2e415e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f0d4 expref: 48 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181494.808973:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1ba785600, rc 0) 00000100:00100000:2.0:1789181494.809032:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c36ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+47:10412:x1876092488027520:12345-192.168.204.32@tcp:101:lfs.0 Request processed in 589us (778us total) trans 4294967345 rc 301/301 00000100:00100000:2.0:1789181494.809040:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 60 00000100:00100000:1.0:1789181494.812409:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181494.813858:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488027648 00000100:00100000:3.0:1789181494.813871:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488027648 00000100:00100000:3.0:1789181494.813968:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 61 00000100:00100000:3.0:1789181494.813980:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c0658380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+47:10412:x1876092488027648:12345-192.168.204.32@tcp:34:lfs.0 00010000:00010000:3.0:1789181494.814053:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e415f3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.814069:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e415f3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.814099:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e415f3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.814115:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e415fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.814122:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e415fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.814141:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e415fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.814231:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e41601 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.814241:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e41601 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.814249:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e41601 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789181494.814290:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e41601 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.814302:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e415f3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.814310:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e415f3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.814317:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e415f3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.814360:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1bfa1f000 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:3.0:1789181494.814364:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e415f3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.814372:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e415f3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.814385:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9dc1995b7200) 00010000:00010000:3.0:1789181494.814389:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181494.814394:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e415f3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.814402:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e415f3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.814416:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e415fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.814422:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e415fa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.814428:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e415fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.814434:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1bfa1fa00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:3.0:1789181494.814438:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e415fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.814444:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e415fa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.814672:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9dc192187800) 00010000:00010000:3.0:1789181494.814676:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181494.814679:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e415fa lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.814687:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e415fa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.814703:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e41601 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.814710:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e41601 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.814716:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e41601 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.814722:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1bfa1fc00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:3.0:1789181494.814725:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e41601 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.814732:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e41601 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.814741:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9dc18553a200) 00010000:00010000:3.0:1789181494.814743:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181494.814746:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e41601 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.814752:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e41601 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181494.814839:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c0658380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+47:10412:x1876092488027648:12345-192.168.204.32@tcp:34:lfs.0 Request processed in 860us (2436us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181494.814847:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 61 00000100:00100000:0.0:1789181494.817449:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181494.817539:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488027904 00000100:00100000:1.0:1789181494.817549:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488027904 00000100:00100000:1.0:1789181494.817602:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 16 00000100:00100000:1.0:1789181494.817613:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfcf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+47:10412:x1876092488027904:12345-192.168.204.32@tcp:35:lfs.0 00000100:00100000:1.0:1789181494.817839:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfcf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+48:10412:x1876092488027904:12345-192.168.204.32@tcp:35:lfs.0 Request processed in 227us (400us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1789181494.817847:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 16 00000100:00100000:0.0:1789181494.845216:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181494.845293:0:6887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488028160 00000100:00100000:3.0:1789181494.845308:0:6887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488028160 00000100:00100000:3.0:1789181494.845545:0:6887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 62 00000100:00100000:3.0:1789181494.845556:0:6887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6b52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+48:10415:x1876092488028160:12345-192.168.204.32@tcp:101:lfs.0 00010000:00010000:3.0:1789181494.845579:0:6887:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181494.845597:0:6887:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e41608 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f0db expref: -99 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.845667:0:6887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e4160f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.845681:0:6887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e4160f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.845692:0:6887:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e4160f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.845707:0:6887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e41616 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.845714:0:6887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e41616 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.845720:0:6887:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e41616 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.845877:0:6887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f800/0x8f4f7840b2e4161d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.845886:0:6887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f800/0x8f4f7840b2e4161d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.845893:0:6887:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f800/0x8f4f7840b2e4161d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789181494.845903:0:6887:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1789181494.846009:0:6887:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e4160f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.846017:0:6887:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e4160f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.846023:0:6887:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e4160f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.846028:0:6887:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1bfa1fa00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:3.0:1789181494.846032:0:6887:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e4160f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.846040:0:6887:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e4160f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.846052:0:6887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9dc1995b7200) 00010000:00010000:3.0:1789181494.846055:0:6887:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181494.846060:0:6887:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e4160f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.846078:0:6887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e4160f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.846094:0:6887:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e41616 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.846099:0:6887:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e41616 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.846105:0:6887:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e41616 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.846111:0:6887:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1bfa1f000 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:3.0:1789181494.846114:0:6887:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e41616 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.846120:0:6887:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e41616 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.846128:0:6887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9dc192187800) 00010000:00010000:3.0:1789181494.846141:0:6887:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181494.846144:0:6887:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e41616 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.846149:0:6887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e41616 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.846191:0:6887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e41608 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f0db expref: 51 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.846204:0:6887:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f800/0x8f4f7840b2e4161d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f0db expref: 50 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.846218:0:6887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9dc18553a200) 00010000:00010000:3.0:1789181494.846221:0:6887:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789181494.846224:0:6887:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1bfa1f800, rc 0) 00000100:00100000:3.0:1789181494.846286:0:6887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6b52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+50:10415:x1876092488028160:12345-192.168.204.32@tcp:101:lfs.0 Request processed in 731us (1082us total) trans 4294967347 rc 0/0 00000100:00100000:3.0:1789181494.846293:0:6887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 62 00010000:00010000:2.0:1789181494.847392:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181494.850641:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181494.850701:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181494.850826:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488028288 00000100:00100000:0.0:1789181494.850836:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488028288 00000100:00100000:0.0:1789181494.850900:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 4 00000100:00100000:0.0:1789181494.850911:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b67aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+50:2353:x1876092488028288:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789181494.850944:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789181494.850969:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f800/0x8f4f7840b2e4161d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f0db expref: 50 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181494.850990:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9dc18553a200) 00010000:00010000:0.0:1789181494.850995:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789181494.851057:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b67aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+49:2353:x1876092488028288:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 146us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181494.851064:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 4 00000100:00100000:3.0:1789181494.851615:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488028416 00000100:00100000:3.0:1789181494.851621:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488028416 00000100:00100000:3.0:1789181494.851656:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 63 00000100:00100000:3.0:1789181494.851665:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b67ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+49:10415:x1876092488028416:12345-192.168.204.32@tcp:54:lfs.0 00010000:00010000:3.0:1789181494.851718:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ea00/0x8f4f7840b2e4162b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.851733:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ea00/0x8f4f7840b2e4162b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.851743:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ea00/0x8f4f7840b2e4162b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.851767:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ea00/0x8f4f7840b2e4162b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.851774:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ea00/0x8f4f7840b2e4162b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.851781:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ea00/0x8f4f7840b2e4162b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.851786:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1bfa1ea00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:3.0:1789181494.851799:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ea00/0x8f4f7840b2e4162b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.851807:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ea00/0x8f4f7840b2e4162b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.851818:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9dc18553a200) 00010000:00010000:3.0:1789181494.851821:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789181494.851824:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ea00/0x8f4f7840b2e4162b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181494.851831:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ea00/0x8f4f7840b2e4162b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181494.851890:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b67ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+49:10415:x1876092488028416:12345-192.168.204.32@tcp:54:lfs.0 Request processed in 226us (1188us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181494.851897:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 63 00000100:00100000:2.0:1789181494.854708:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181494.854890:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488028672 00000100:00100000:1.0:1789181494.854901:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488028672 00000100:00100000:1.0:1789181494.854988:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 17 00000100:00100000:1.0:1789181494.854997:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b67a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+49:10415:x1876092488028672:12345-192.168.204.32@tcp:35:lfs.0 00000100:00100000:1.0:1789181494.855241:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b67a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+50:10415:x1876092488028672:12345-192.168.204.32@tcp:35:lfs.0 Request processed in 245us (541us total) trans 4294967348 rc 0/0 00000100:00100000:1.0:1789181494.855248:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 17 00000100:00100000:2.0:1789181495.004869:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181495.004976:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488028928 00000100:00100000:0.0:1789181495.004986:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488028928 00000100:00100000:0.0:1789181495.005073:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 64 00000100:00100000:0.0:1789181495.005084:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b67aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+50:10433:x1876092488028928:12345-192.168.204.32@tcp:101:cat.0 00010000:00010000:0.0:1789181495.005111:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181495.005143:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891c00/0x8f4f7840b2e41632 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f0e2 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181495.005243:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891000/0x8f4f7840b2e41639 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181495.005258:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891000/0x8f4f7840b2e41639 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181495.005270:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891000/0x8f4f7840b2e41639 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789181495.005281:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1789181495.005451:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891c00/0x8f4f7840b2e41632 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f0e2 expref: 53 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181495.005481:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891000/0x8f4f7840b2e41639 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f0e2 expref: 52 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181495.005490:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9dc18553a200) 00010000:00010000:0.0:1789181495.005493:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789181495.005496:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc189891000, rc 0) 00000100:00100000:0.0:1789181495.005563:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b67aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+52:10433:x1876092488028928:12345-192.168.204.32@tcp:101:cat.0 Request processed in 482us (704us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1789181495.005570:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 64 00000100:00080000:1.0:1789181495.006135:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789181495.024699:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181495.024808:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488029056 00000100:00100000:3.0:1789181495.024819:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488029056 00000100:00100000:3.0:1789181495.024878:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 65 00000100:00100000:3.0:1789181495.024890:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b67ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+52:10434:x1876092488029056:12345-192.168.204.32@tcp:101:lfs.0 00010000:00010000:3.0:1789181495.024913:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181495.024932:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ea00/0x8f4f7840b2e41647 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f0e9 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181495.024998:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e4164e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181495.025012:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e4164e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181495.025041:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e4164e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789181495.025076:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1789181495.025080:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789181495.025098:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e4164e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181495.025295:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ea00/0x8f4f7840b2e41647 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f0e9 expref: 54 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181495.025314:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e4164e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f0e9 expref: 53 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181495.025324:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9dc1995b7200) 00010000:00010000:3.0:1789181495.025327:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789181495.025381:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1bfa1fc00, rc 0) 00000100:00100000:3.0:1789181495.025444:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b67ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+53:10434:x1876092488029056:12345-192.168.204.32@tcp:101:lfs.0 Request processed in 554us (751us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181495.025452:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 65 00000100:00100000:2.0:1789181495.029054:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181495.029147:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488029440 00000100:00100000:0.0:1789181495.029158:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488029440 00000100:00100000:0.0:1789181495.029226:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 18 00000100:00100000:0.0:1789181495.029237:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b67aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+53:10434:x1876092488029440:12345-192.168.204.32@tcp:35:lfs.0 00000100:00100000:0.0:1789181495.029594:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b67aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+54:10434:x1876092488029440:12345-192.168.204.32@tcp:35:lfs.0 Request processed in 358us (549us total) trans 4294967350 rc 0/0 00000100:00100000:0.0:1789181495.029602:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 18 00000100:00100000:2.0:1789181495.032006:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181495.032444:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488029568 00000100:00100000:0.0:1789181495.032454:0:8456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488029568 00000100:00100000:0.0:1789181495.032518:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 5 00000100:00100000:0.0:1789181495.032528:0:8456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b67a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5971a429-48ca-4c07-88a3-fa58102a53bc+54:10434:x1876092488029568:12345-192.168.204.32@tcp:103:lfs.0 00010000:00010000:0.0:1789181495.032543:0:8456:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789181495.032566:0:8456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890e00/0x8f4f7840b2e415de lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f0cd expref: 54 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181495.032587:0:8456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891000/0x8f4f7840b2e41639 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f0e2 expref: 53 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181495.032616:0:8456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891200/0x8f4f7840b2e414e9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f08e expref: 52 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181495.032625:0:8456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9dc18553a200) 00010000:00010000:0.0:1789181495.032636:0:8456:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789181495.032693:0:8456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b67a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5971a429-48ca-4c07-88a3-fa58102a53bc+51:10434:x1876092488029568:12345-192.168.204.32@tcp:103:lfs.0 Request processed in 166us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181495.032709:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 5 00000100:00100000:2.0:1789181495.035275:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181495.035404:0:6887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488029696 00000100:00100000:3.0:1789181495.035414:0:6887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488029696 00000100:00100000:3.0:1789181495.035499:0:6887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 66 00000100:00100000:3.0:1789181495.035510:0:6887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b67a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+51:10434:x1876092488029696:12345-192.168.204.32@tcp:58:lfs.0 00010000:00010000:3.0:1789181495.035614:0:6887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ea00/0x8f4f7840b2e41655 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181495.035631:0:6887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ea00/0x8f4f7840b2e41655 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181495.035662:0:6887:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ea00/0x8f4f7840b2e41655 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789181495.035952:0:6887:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789181495.036157:0:6887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:3.0:1789181495.036233:0:6887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:3.0:1789181495.036367:0:6887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b67a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+51:10434:x1876092488029696:12345-192.168.204.32@tcp:58:lfs.0 Request processed in 857us (1100us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181495.036376:0:6887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 66 00000100:00100000:2.0:1789181495.061440:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181495.061527:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488029824 00000100:00100000:0.0:1789181495.061538:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488029824 00000100:00100000:0.0:1789181495.061595:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 67 00000100:00100000:0.0:1789181495.061605:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b67a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+51:10436:x1876092488029824:12345-192.168.204.32@tcp:101:lfs.0 00010000:00010000:0.0:1789181495.061623:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181495.061645:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891200/0x8f4f7840b2e4165c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f0f0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181495.061824:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891000/0x8f4f7840b2e41663 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181495.061839:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891000/0x8f4f7840b2e41663 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181495.061849:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891000/0x8f4f7840b2e41663 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181495.061862:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890e00/0x8f4f7840b2e4166a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181495.061956:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890e00/0x8f4f7840b2e4166a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181495.061963:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890e00/0x8f4f7840b2e4166a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181495.062047:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891c00/0x8f4f7840b2e41671 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181495.062055:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891c00/0x8f4f7840b2e41671 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181495.062062:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891c00/0x8f4f7840b2e41671 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789181495.062425:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1789181495.062431:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789181495.062453:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891c00/0x8f4f7840b2e41671 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181495.062466:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891c00/0x8f4f7840b2e41671 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181495.062474:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891000/0x8f4f7840b2e41663 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181495.062480:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891000/0x8f4f7840b2e41663 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181495.062486:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891000/0x8f4f7840b2e41663 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181495.062504:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc189891000 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:0.0:1789181495.062509:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891000/0x8f4f7840b2e41663 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181495.062515:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891000/0x8f4f7840b2e41663 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181495.062527:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9dc1995b7200) 00010000:00010000:0.0:1789181495.062529:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789181495.062534:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891000/0x8f4f7840b2e41663 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181495.062539:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891000/0x8f4f7840b2e41663 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181495.062552:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890e00/0x8f4f7840b2e4166a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181495.062557:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890e00/0x8f4f7840b2e4166a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181495.062562:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890e00/0x8f4f7840b2e4166a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181495.062566:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc189890e00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:0.0:1789181495.062568:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890e00/0x8f4f7840b2e4166a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181495.062572:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890e00/0x8f4f7840b2e4166a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181495.062587:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9dc18553a200) 00010000:00010000:0.0:1789181495.062589:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789181495.062592:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890e00/0x8f4f7840b2e4166a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181495.062597:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890e00/0x8f4f7840b2e4166a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181495.062629:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891200/0x8f4f7840b2e4165c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f0f0 expref: 53 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181495.062641:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891c00/0x8f4f7840b2e41671 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f0f0 expref: 52 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181495.062648:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9dc192187800) 00010000:00010000:0.0:1789181495.062650:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789181495.062653:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc189891c00, rc 0) 00000100:00100000:0.0:1789181495.063581:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b67a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+52:10436:x1876092488029824:12345-192.168.204.32@tcp:101:lfs.0 Request processed in 1725us (1897us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181495.063594:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 67 00000100:00100000:0.0:1789181495.294506:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789181495.295440:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1ba768380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1876092510077312:0@lo:400:kworker.0 00000100:00100000:3.0:1789181495.295504:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181495.295557:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789181495.295562:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b67aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876092510077184:0@lo:400:kworker.0 00000100:00100000:3.0:1789181495.295581:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181495.295611:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510077312 00000100:00100000:3.0:1789181495.295618:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510077312 00000100:00100000:3.0:1789181495.295664:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510077184 00000100:00100000:3.0:1789181495.295666:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510077184 00000100:00100000:3.0:1789181495.295683:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1789181495.295690:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1ba4aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876092510077312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181495.295734:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1ba4aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876092510077312:12345-0@lo:400:kworker.0 Request processed in 44us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181495.295740:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1789181495.295755:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1789181495.295760:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1ba4ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876092510077184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181495.295779:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1ba4ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876092510077184:12345-0@lo:400:kworker.0 Request processed in 20us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181495.295791:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00080000:3.0:1789181495.295814:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789181495.295846:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b67aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876092510077184:0@lo:400:kworker.0 00000100:00100000:3.0:1789181495.295854:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1ba768380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1876092510077312:0@lo:400:kworker.0 00000100:00100000:0.0:1789181495.300898:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1ba769f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510077440:0@lo:400:kworker.0 00000100:00100000:0.0:1789181495.300977:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181495.301069:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b67a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:880710ad-110c-42a4-a174-ab1b99a7ebeb:3305:1876092510077056:0@lo:400:kworker.0 00000100:00100000:0.0:1789181495.301102:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181495.301156:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789181495.301163:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1ba769880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1876092510077568:0@lo:400:kworker.0 00000100:00100000:0.0:1789181495.301213:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181495.301258:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510077056 00000100:00100000:2.0:1789181495.301264:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1ba769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876092510077696:0@lo:400:kworker.0 00000100:00100000:0.0:1789181495.301267:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510077056 00000100:00100000:2.0:1789181495.301294:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181495.301583:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1789181495.301594:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:3305:x1876092510077056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181495.301699:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:3305:x1876092510077056:12345-0@lo:400:kworker.0 Request processed in 106us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181495.301707:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1789181495.301742:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510077568 00000100:00100000:0.0:1789181495.301746:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510077568 00000100:00100000:0.0:1789181495.301784:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789181495.301791:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6b51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876092510077568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181495.301821:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6b51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876092510077568:12345-0@lo:400:kworker.0 Request processed in 31us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181495.301827:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00080000:0.0:1789181495.301844:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789181495.302005:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1ba769880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1876092510077568:0@lo:400:kworker.0 00000100:00100000:1.0:1789181495.302016:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b67a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:880710ad-110c-42a4-a174-ab1b99a7ebeb:3305:1876092510077056:0@lo:400:kworker.0 00000100:00100000:3.0:1789181495.303016:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510077440 00000100:00100000:3.0:1789181495.303028:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510077440 00000100:00080000:1.0:1789181495.303099:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789181495.303233:0:6894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510077696 00000100:00100000:0.0:1789181495.303239:0:6894:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510077696 00000100:00100000:0.0:1789181495.303282:0:6894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789181495.303291:0:6894:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6b53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3305:x1876092510077440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181495.303404:0:6894:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6b53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3305:x1876092510077440:12345-0@lo:400:kworker.0 Request processed in 114us (2427us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181495.303411:0:6894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789181495.303426:0:6894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789181495.303432:0:6894:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1ba768700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1876092510077696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181495.303463:0:6894:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1ba768700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1876092510077696:12345-0@lo:400:kworker.0 Request processed in 31us (2168us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181495.303477:0:6894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789181495.303518:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1ba769f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510077440:0@lo:400:kworker.0 00000100:00080000:1.0:1789181495.303599:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789181495.303803:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1ba769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876092510077696:0@lo:400:kworker.0 00000100:00100000:2.0:1789181495.807139:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c0659f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876092510077824:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789181495.807212:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181495.807265:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510077824 00000100:00100000:1.0:1789181495.807275:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510077824 00000100:00100000:1.0:1789181495.807386:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789181495.807397:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1ba769180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876092510077824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789181495.807434:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789181495.807488:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1ba769180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876092510077824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181495.807496:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789181495.807793:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c0659f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876092510077824:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1789181495.867224:0:12010:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789181495.867232:0:12010:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789181495.867270:0:12010:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1789181495.867276:0:12010:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1789181495.871962:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789181495.998623:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789181495.998632:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789181495.998705:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1789181495.998717:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789181495.998870:0:11694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6b51500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11694:1876092510077952:192.168.204.32@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789181495.999046:0:11694:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1c062e540 going to sleep for 11 seconds 00000100:00100000:1.0:1789181496.007369:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181496.007481:0:11694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6b51500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11694:1876092510077952:192.168.204.32@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789181496.007738:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488029952 00000100:00100000:3.0:1789181496.007746:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488029952 00000100:00100000:3.0:1789181496.009367:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1 00000100:00100000:3.0:1789181496.009386:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c0659f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:5971a429-48ca-4c07-88a3-fa58102a53bc+52:10449:x1876092488029952:12345-192.168.204.32@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1789181496.009473:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c0659f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:5971a429-48ca-4c07-88a3-fa58102a53bc+52:10449:x1876092488029952:12345-192.168.204.32@tcp:900:lhsmtool_posix.0 Request processed in 95us (2149us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181496.009480:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1 00000100:00100000:1.0:1789181496.013453:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181496.013523:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488030080 00000100:00100000:3.0:1789181496.013533:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488030080 00000100:00100000:3.0:1789181496.013582:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 68 00000100:00100000:3.0:1789181496.013592:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c065b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+52:10449:x1876092488030080:12345-192.168.204.32@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789181496.013637:0:5843:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789181496.013795:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c065b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+52:10449:x1876092488030080:12345-192.168.204.32@tcp:53:lhsmtool_posix.0 Request processed in 203us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181496.013803:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 68 00000100:00100000:3.0:1789181496.022079:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181496.022210:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488030208 00000100:00100000:0.0:1789181496.022220:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488030208 00000100:00100000:0.0:1789181496.022283:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 69 00000100:00100000:0.0:1789181496.022293:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1ba4a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+52:10449:x1876092488030208:12345-192.168.204.32@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789181496.022392:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891400/0x8f4f7840b2e41678 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181496.022412:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891400/0x8f4f7840b2e41678 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181496.022425:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891400/0x8f4f7840b2e41678 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181496.022474:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890400/0x8f4f7840b2e4167f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181496.022482:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890400/0x8f4f7840b2e4167f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181496.022488:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890400/0x8f4f7840b2e4167f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181496.022513:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e41686 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181496.022521:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e41686 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181496.022527:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e41686 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789181496.022565:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1789181496.022569:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789181496.022582:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e41686 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181496.022593:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891400/0x8f4f7840b2e41678 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181496.022600:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891400/0x8f4f7840b2e41678 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181496.022606:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891400/0x8f4f7840b2e41678 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181496.022620:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc189891400 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:0.0:1789181496.022625:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891400/0x8f4f7840b2e41678 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181496.022632:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891400/0x8f4f7840b2e41678 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181496.022644:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9dc192187200) 00010000:00010000:0.0:1789181496.022647:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789181496.022652:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891400/0x8f4f7840b2e41678 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181496.022658:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891400/0x8f4f7840b2e41678 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181496.022677:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890400/0x8f4f7840b2e4167f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181496.022683:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890400/0x8f4f7840b2e4167f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181496.022692:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890400/0x8f4f7840b2e4167f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181496.022698:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc189890400 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:0.0:1789181496.022701:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890400/0x8f4f7840b2e4167f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181496.022707:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890400/0x8f4f7840b2e4167f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181496.022726:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff9dc18553a200) 00010000:00010000:0.0:1789181496.022728:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789181496.022731:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890400/0x8f4f7840b2e4167f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181496.022737:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890400/0x8f4f7840b2e4167f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181496.022750:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e41686 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181496.022757:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e41686 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181496.022762:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e41686 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181496.022768:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc189890000 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:0.0:1789181496.022771:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e41686 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181496.022776:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e41686 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181496.022783:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9dc192187800) 00010000:00010000:0.0:1789181496.022785:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789181496.022787:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e41686 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181496.022792:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e41686 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181496.023348:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1ba4a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+52:10449:x1876092488030208:12345-192.168.204.32@tcp:34:lhsmtool_posix.0 Request processed in 1041us (1260us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181496.023357:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 69 00000100:00100000:3.0:1789181496.034167:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181496.034211:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488030464 00000100:00100000:3.0:1789181496.034222:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488030464 00000100:00100000:3.0:1789181496.034288:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 70 00000100:00100000:3.0:1789181496.034298:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1ba4aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+52:10449:x1876092488030464:12345-192.168.204.32@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789181496.034318:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181496.034355:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e4168d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f0f7 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181496.034453:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e41694 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181496.034468:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e41694 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181496.034480:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e41694 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789181496.034492:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1789181496.034595:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e41694 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181496.034604:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e41694 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181496.034612:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e41694 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181496.034618:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1bfa1fa00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:3.0:1789181496.034623:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e41694 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181496.034648:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e41694 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181496.034686:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9dc192187800) 00010000:00010000:3.0:1789181496.034689:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789181496.034697:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e41694 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181496.034704:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e41694 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181496.034754:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e4168d lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f0f7 expref: 54 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181496.035008:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9dc192187200) 00010000:00010000:3.0:1789181496.035012:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789181496.035017:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e4168d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f0f7 expref: 54 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181496.035029:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1bfa1f000, rc 0) 00000100:00100000:3.0:1789181496.035093:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1ba4aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+53:10449:x1876092488030464:12345-192.168.204.32@tcp:101:lhsmtool_posix.0 Request processed in 796us (947us total) trans 4294967351 rc 301/301 00000100:00100000:3.0:1789181496.035102:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 70 00000100:00100000:3.0:1789181496.038602:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181496.038953:0:6887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488030592 00000100:00100000:2.0:1789181496.038964:0:6887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488030592 00000100:00100000:2.0:1789181496.039027:0:6887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 71 00000100:00100000:2.0:1789181496.039039:0:6887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1ba4ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+53:10449:x1876092488030592:12345-192.168.204.32@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789181496.039073:0:6887:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789181496.039201:0:6887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1ba4ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+53:10449:x1876092488030592:12345-192.168.204.32@tcp:53:lhsmtool_posix.0 Request processed in 164us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181496.039209:0:6887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 71 00000100:00100000:3.0:1789181496.045316:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181496.045425:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488030848 00000100:00100000:1.0:1789181496.045435:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488030848 00000100:00100000:1.0:1789181496.045500:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 72 00000100:00100000:1.0:1789181496.045512:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1ba4aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+53:10449:x1876092488030848:12345-192.168.204.32@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789181496.045535:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181496.045539:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789181496.045566:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e4164e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f0e9 expref: 53 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181496.045587:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9dc1995b7200) 00010000:00010000:1.0:1789181496.045592:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789181496.045606:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151a800/0x8f4f7840b2e416a2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f0fe expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789181496.046059:0:5843:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:1.0:1789181496.046306:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151a000/0x8f4f7840b2e416a9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181496.046321:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151a000/0x8f4f7840b2e416a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181496.046373:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151a000/0x8f4f7840b2e416a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181496.046436:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151a800/0x8f4f7840b2e416a2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f0fe expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181496.046454:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151a000/0x8f4f7840b2e416a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f0fe expref: 54 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181496.046464:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9dc18a6c2100) 00010000:00010000:1.0:1789181496.046466:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789181496.046469:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc18151a000, rc 0) 00000100:00100000:1.0:1789181496.046526:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1ba4aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+54:10449:x1876092488030848:12345-192.168.204.32@tcp:101:lhsmtool_posix.0 Request processed in 1016us (1220us total) trans 4294967352 rc 0/0 00000100:00100000:1.0:1789181496.046534:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 72 00000100:00100000:2.0:1789181496.060734:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181496.060816:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488031104 00000100:00100000:0.0:1789181496.060826:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488031104 00000100:00100000:0.0:1789181496.060879:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 73 00000100:00100000:0.0:1789181496.060888:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1ba769500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+54:10449:x1876092488031104:12345-192.168.204.32@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789181496.060941:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789181496.060972:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151a000/0x8f4f7840b2e416a9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f0fe expref: 54 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181496.060991:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9dc18a6c2100) 00010000:00010000:0.0:1789181496.061001:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789181496.061023:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e416b7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181496.061036:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e416b7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181496.061044:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e416b7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181496.061104:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890400/0x8f4f7840b2e416be lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x7df4881e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181496.061129:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890400/0x8f4f7840b2e416be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x7df4881e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181496.061136:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890400/0x8f4f7840b2e416be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x7df4881e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181496.061209:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e416b7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181496.061217:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e416b7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181496.061224:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e416b7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181496.061230:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc189890000 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:0.0:1789181496.061234:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e416b7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181496.061241:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e416b7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181496.061250:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9dc1995b7200) 00010000:00010000:0.0:1789181496.061253:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789181496.061257:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e416b7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181496.061263:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e416b7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181496.061273:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890400/0x8f4f7840b2e416be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x7df4881e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181496.061279:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890400/0x8f4f7840b2e416be lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x7df4881e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181496.061284:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890400/0x8f4f7840b2e416be lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x7df4881e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181496.061295:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc189890400 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:0.0:1789181496.061298:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890400/0x8f4f7840b2e416be lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x7df4881e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181496.061305:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890400/0x8f4f7840b2e416be lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x7df4881e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181496.061313:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x7df4881e (ffff9dc18553a200) 00010000:00010000:0.0:1789181496.061316:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789181496.061318:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890400/0x8f4f7840b2e416be lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x7df4881e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181496.061324:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890400/0x8f4f7840b2e416be lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x7df4881e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181496.061440:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1ba769500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+53:10449:x1876092488031104:12345-192.168.204.32@tcp:36:lhsmtool_posix.0 Request processed in 551us (715us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789181496.061447:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 73 00000100:00100000:0.0:1789181496.071202:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181496.071363:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488031232 00000100:00100000:1.0:1789181496.071374:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488031232 00000100:00100000:1.0:1789181496.071427:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 74 00000100:00100000:1.0:1789181496.071436:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6b51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+53:10449:x1876092488031232:12345-192.168.204.32@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789181496.072100:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181496.072139:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151a800/0x8f4f7840b2e416c5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f105 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181496.072178:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e416cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181496.072193:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e416cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181496.072212:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e416cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181496.072313:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151a800/0x8f4f7840b2e416c5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f105 expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181496.072348:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e416cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f105 expref: 54 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181496.072358:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9dc18a6c2d00) 00010000:00010000:1.0:1789181496.072361:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789181496.072365:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc18151ae00, rc 0) 00000100:00100000:1.0:1789181496.072424:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6b51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+54:10449:x1876092488031232:12345-192.168.204.32@tcp:101:lhsmtool_posix.0 Request processed in 988us (1232us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181496.072430:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 74 00000100:00100000:3.0:1789181496.081419:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181496.081457:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488031488 00000100:00100000:3.0:1789181496.081467:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488031488 00000100:00100000:3.0:1789181496.081526:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 75 00000100:00100000:3.0:1789181496.081535:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1ba4a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+54:10449:x1876092488031488:12345-192.168.204.32@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789181496.081630:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e416d3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181496.081647:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e416d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181496.081659:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e416d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789181496.083077:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:3.0:1789181496.083090:0:5844:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 388339759195ns, next at 389339755544ns, rc = 0 00000004:00010000:3.0:1789181496.083472:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a3311f42 reply state 0000000010b12f8d transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e416d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181496.083484:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789181496.083594:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1ba4a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+56:10449:x1876092488031488:12345-192.168.204.32@tcp:36:lhsmtool_posix.0 Request processed in 2056us (2178us total) trans 4294967353 rc 0/0 00000100:00100000:3.0:1789181496.083603:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 75 00010000:00010000:3.0:1789181496.087840:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e416d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181496.087870:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e416d3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181496.087878:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e416d3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181496.087885:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1bfa1fe00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:3.0:1789181496.087890:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e416d3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181496.087908:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e416d3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181496.087926:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9dc18a6c2d00) 00010000:00010000:3.0:1789181496.087929:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789181496.087935:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e416d3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181496.087941:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e416d3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181496.089720:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181496.090307:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488031616 00000100:00100000:2.0:1789181496.090318:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488031616 00000100:00100000:2.0:1789181496.090403:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 76 00000100:00100000:2.0:1789181496.090413:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1ba4ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+55:10449:x1876092488031616:12345-192.168.204.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789181496.090436:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181496.090455:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784000/0x8f4f7840b2e416da lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f10c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181496.090513:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784000/0x8f4f7840b2e416da lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f10c expref: 56 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181496.090528:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784000/0x8f4f7840b2e416da lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f10c expref: 56 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181496.090547:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9dc18a6c2d00) 00010000:00010000:2.0:1789181496.090550:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789181496.090554:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1ba784000, rc 0) 00000100:00100000:2.0:1789181496.090607:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1ba4ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+56:10449:x1876092488031616:12345-192.168.204.32@tcp:101:lhsmtool_posix.0 Request processed in 196us (896us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181496.090614:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 76 00000100:00100000:3.0:1789181496.095030:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181496.095667:0:6894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488031744 00000100:00100000:0.0:1789181496.095679:0:6894:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488031744 00000100:00100000:0.0:1789181496.095720:0:6894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 24 00000100:00100000:0.0:1789181496.095727:0:6894:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1ba4a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2350:x1876092488031744:12345-192.168.204.32@tcp:8:lhsmtool_posix.0 00010000:00080000:0.0:1789181496.095759:0:6894:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 5971a429-48ca-4c07-88a3-fa58102a53bc@192.168.204.32@tcp t0 exp 0000000000000000 cur 388 last 0 00000020:00000080:0.0:1789181496.097757:0:6894:0:(genops.c:1384:class_connect()) connect: client 5971a429-48ca-4c07-88a3-fa58102a53bc, cookie 0x8f4f7840b2e416e1 00002000:00100000:0.0:1789181496.097777:0:6894:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 5971a429-48ca-4c07-88a3-fa58102a53bc/ffff9dc190619000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789181496.097796:0:6894:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789181496.098251:0:6894:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789181496.098288:0:6894:0:(import.c:65:import_set_state_nolock()) ffff9dc19061c800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789181496.098498:0:6894:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1ba4a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+6:2350:x1876092488031744:12345-192.168.204.32@tcp:8:lhsmtool_posix.0 Request processed in 2768us (3476us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181496.098508:0:6894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 24 00000100:00100000:3.0:1789181496.102389:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181496.102461:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488031872 00000100:00100000:0.0:1789181496.102471:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488031872 00000100:00100000:0.0:1789181496.102534:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 25 00000100:00100000:0.0:1789181496.102544:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1ba4aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+6:0:x1876092488031872:12345-192.168.204.32@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1789181496.102816:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1789181496.168648:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00100000:3.0:1789181496.168664:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5971a429-48ca-4c07-88a3-fa58102a53bc 00000100:00100000:2.0:1789181496.168840:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1ba4aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+5:0:x1876092488031872:12345-192.168.204.32@tcp:2:lhsmtool_posix.0 Request processed in 66292us (66455us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1789181496.168857:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 25 00000100:00100000:2.0:1789181496.176479:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181496.177072:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488032128 00000100:00100000:0.0:1789181496.177083:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488032128 00000100:00100000:0.0:1789181496.177155:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 19 00000100:00100000:0.0:1789181496.177175:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1ba76a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+56:10449:x1876092488032128:12345-192.168.204.32@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789181496.177444:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1ba76a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+57:10449:x1876092488032128:12345-192.168.204.32@tcp:35:lhsmtool_posix.0 Request processed in 280us (976us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1789181496.177451:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 19 00000100:00100000:3.0:1789181496.181952:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181496.182126:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488032384 00000100:00100000:0.0:1789181496.182136:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488032384 00000100:00100000:0.0:1789181496.182204:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 77 00000100:00100000:0.0:1789181496.182214:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1ba4a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+57:10449:x1876092488032384:12345-192.168.204.32@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789181496.182364:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1ba4a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+57:10449:x1876092488032384:12345-192.168.204.32@tcp:57:lhsmtool_posix.0 Request processed in 116us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181496.182373:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 77 00000100:00100000:3.0:1789181496.185480:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181496.185611:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488032512 00000100:00100000:2.0:1789181496.185619:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488032512 00000100:00100000:2.0:1789181496.185693:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 78 00000100:00100000:2.0:1789181496.185708:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1ba4abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+57:10449:x1876092488032512:12345-192.168.204.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789181496.185732:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181496.185770:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785a00/0x8f4f7840b2e416e8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f113 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181496.185846:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e416ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181496.185861:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e416ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181496.185875:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e416ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789181496.185922:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789181496.185945:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e416ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181496.185978:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785a00/0x8f4f7840b2e416e8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f113 expref: 59 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181496.185998:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e416ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f113 expref: 58 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181496.186008:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9dc18a6c2d00) 00010000:00010000:2.0:1789181496.186011:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789181496.186015:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1ba785c00, rc 0) 00000100:00100000:2.0:1789181496.186081:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1ba4abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+58:10449:x1876092488032512:12345-192.168.204.32@tcp:101:lhsmtool_posix.0 Request processed in 379us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181496.186089:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 78 00000100:00100000:2.0:1789181496.189488:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181496.189606:0:6894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488032640 00000100:00100000:0.0:1789181496.189616:0:6894:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488032640 00000100:00100000:0.0:1789181496.189713:0:6894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 26 00000100:00100000:0.0:1789181496.189724:0:6894:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1ba76b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+5:2354:x1876092488032640:12345-192.168.204.32@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789181496.189742:0:6894:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181496.189765:0:6894:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004496a812/0x8f4f7840b2e416f6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f11a expref: -99 pid: 6894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789181496.189791:0:6894:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa4be39, blocks: 0x1 00010000:00010000:0.0:1789181496.189811:0:6894:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=388s v=(0 0) 00010000:00010000:0.0:1789181496.189815:0:6894:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789181496.189825:0:6894:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004496a812/0x8f4f7840b2e416f6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f11a expref: 6 pid: 6894 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181496.189844:0:6894:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004496a812/0x8f4f7840b2e416f6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f11a expref: 6 pid: 6894 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181496.189856:0:6894:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc189891400, rc 0) 00000100:00100000:0.0:1789181496.189914:0:6894:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1ba76b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+6:2354:x1876092488032640:12345-192.168.204.32@tcp:101:lhsmtool_posix.0 Request processed in 192us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181496.189921:0:6894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 26 00000100:00100000:0.0:1789181496.192490:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181496.192990:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488032896 00000100:00100000:3.0:1789181496.193002:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488032896 00000100:00100000:3.0:1789181496.193121:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 79 00000100:00100000:3.0:1789181496.193133:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6b50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+58:10449:x1876092488032896:12345-192.168.204.32@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789181496.193262:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6b50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+58:10449:x1876092488032896:12345-192.168.204.32@tcp:57:lhsmtool_posix.0 Request processed in 131us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181496.193270:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 79 00000100:00100000:3.0:1789181496.195777:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181496.195858:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488033024 00000100:00100000:0.0:1789181496.195866:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488033024 00000100:00100000:0.0:1789181496.195921:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 27 00000100:00100000:0.0:1789181496.195931:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1ba4a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+6:10449:x1876092488033024:12345-192.168.204.32@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789181496.195949:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181496.195968:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ad75d4d4/0x8f4f7840b2e416fd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f121 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181496.196016:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004496a812/0x8f4f7840b2e416f6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f11a expref: 7 pid: 6894 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181496.196026:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789181496.196035:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789181496.196041:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad75d4d4/0x8f4f7840b2e416fd lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f121 expref: 7 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181496.196076:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004496a812/0x8f4f7840b2e416f6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f11a expref: 7 pid: 6894 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181496.196090:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004496a812/0x8f4f7840b2e416f6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f11a expref: 7 pid: 6894 timeout: 488 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181496.196114:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6b51f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6691:1876092510078080:192.168.204.32@tcp:104: 00000100:00100000:0.0:1789181496.196219:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc189a449c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789181496.198990:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181496.199092:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6b51f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6691:1876092510078080:192.168.204.32@tcp:104: 00010000:00010000:3.0:1789181496.199166:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ad75d4d4/0x8f4f7840b2e416fd lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f121 expref: 7 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181496.199186:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc189890200, rc 0) 00000100:00100000:3.0:1789181496.199248:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1ba4a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+7:10449:x1876092488033024:12345-192.168.204.32@tcp:101:lhsmtool_posix.0 Request processed in 3318us (3477us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181496.199257:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 27 00000100:00100000:1.0:1789181496.199781:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488033152 00000100:00100000:1.0:1789181496.199789:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488033152 00010000:00010000:1.0:1789181496.199823:0:6707:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004496a812/0x8f4f7840b2e416f6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f11a expref: 7 pid: 6894 timeout: 488 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181496.199858:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 42 00000100:00100000:1.0:1789181496.199868:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1960f3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+7:2354:x1876092488033152:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789181496.199881:0:6707:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789181496.199904:0:6707:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004496a812/0x8f4f7840b2e416f6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f11a expref: 7 pid: 6894 timeout: 488 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181496.199930:0:6707:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004496a812/0x8f4f7840b2e416f6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f11a expref: 7 pid: 6894 timeout: 488 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181496.199954:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004496a812/0x8f4f7840b2e416f6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f11a expref: 7 pid: 6894 timeout: 488 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181496.199969:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789181496.199974:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789181496.199982:0:6707:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ad75d4d4/0x8f4f7840b2e416fd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f121 expref: 6 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181496.199993:0:6707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad75d4d4/0x8f4f7840b2e416fd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f121 expref: 6 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181496.200027:0:6707:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ad75d4d4/0x8f4f7840b2e416fd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f121 expref: 6 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181496.200041:0:6707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c065b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6707:1876092510078208:192.168.204.32@tcp:105: 00000100:00100000:1.0:1789181496.200577:0:6707:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc190660300 going to sleep for 11 seconds 00000100:00100000:1.0:1789181496.204117:0:6707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c065b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6707:1876092510078208:192.168.204.32@tcp:105: 00010000:00010000:1.0:1789181496.204145:0:6707:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789181496.204206:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1960f3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+6:2354:x1876092488033152:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 4338us (5225us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181496.204216:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 42 00000100:00100000:3.0:1789181496.206270:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181496.206439:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488033280 00000100:00100000:1.0:1789181496.206447:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488033280 00002000:00100000:1.0:1789181496.206492:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9dc1b67a8700 x1876092488033280/t0(0) o4->5971a429-48ca-4c07-88a3-fa58102a53bc@192.168.204.32@tcp:627/0 lens 504/0 e 0 to 0 dl 1789181507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789181496.206503:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9dc1b67a8700 with x1876092488033280 ext(0->8) 00002000:00010000:1.0:1789181496.206508:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9dc1b67a8700 00000100:00100000:1.0:1789181496.206528:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 0 00000100:00100000:1.0:1789181496.206536:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b67a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+6:2354:x1876092488033280:12345-192.168.204.32@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789181496.207223:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b67a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+8:2354:x1876092488033280:12345-192.168.204.32@tcp:4:lhsmtool_posix.0 Request processed in 685us (959us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1789181496.207232:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 0 00002000:00100000:1.0:1789181496.207240:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9dc1b67a8700 x1876092488033280/t4294967302(0) o4->5971a429-48ca-4c07-88a3-fa58102a53bc@192.168.204.32@tcp:627/0 lens 504/448 e 0 to 0 dl 1789181507 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789181496.207249:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9dc1b67a8700 with x1876092488033280 ext(0->8) 00002000:00010000:1.0:1789181496.207252:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9dc1b67a8700 00000100:00100000:2.0:1789181496.209612:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181496.209750:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488033408 00000100:00100000:1.0:1789181496.209760:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488033408 00000100:00100000:1.0:1789181496.209817:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 80 00000100:00100000:1.0:1789181496.209828:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1ba768000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+58:10449:x1876092488033408:12345-192.168.204.32@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1789181496.246858:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:2.0:1789181496.246931:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000004:00080000:2.0:1789181496.246971:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:2.0:1789181496.246991:0:5865:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9dc19c38d540 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:2.0:1789181496.246995:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9dc1879a9100 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9dc19c38d840 00000020:00080000:2.0:1789181496.246999:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9dc1879a9900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9dc1b6c28400 00000100:00100000:2.0:1789181496.247158:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789181496.247177:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1ba76aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876092510078336:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789181496.247244:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181496.247291:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510078336 00000100:00100000:2.0:1789181496.247299:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510078336 00000100:00100000:2.0:1789181496.247367:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789181496.247377:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1ba76b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3306:x1876092510078336:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789181496.247403:0:6692:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:2.0:1789181496.247439:0:6692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6aa4be36, atime: 0x6aa4be36, ctime: 0x6aa4be36, blocks: 0xb 00010000:00010000:2.0:1789181496.247449:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0230f91/0x8f4f7840b2e41704 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181496.247465:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=388s v=(0 0) 00010000:00010000:2.0:1789181496.247469:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789181496.247475:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0230f91/0x8f4f7840b2e41704 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181496.247491:0:6692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0230f91/0x8f4f7840b2e41704 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181496.247502:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0230f91/0x8f4f7840b2e41704 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181496.247524:0:6692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a0230f91/0x8f4f7840b2e41704 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181496.247542:0:6692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789181496.248182:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1ba76b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3306:x1876092510078336:12345-0@lo:6:osp-syn-0-0.0 Request processed in 805us (937us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1789181496.248191:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:2.0:1789181496.248218:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789181496.248224:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a0230f91/0x8f4f7840b2e41704 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181496.248235:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1ba785600 already unused, calling callback (ffffffffc152f9b0) 00010000:00010000:2.0:1789181496.248240:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0230f91/0x8f4f7840b2e41704 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181496.248250:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0230f91/0x8f4f7840b2e41704 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181496.248269:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a0230f91/0x8f4f7840b2e41704 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181496.248277:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0230f91/0x8f4f7840b2e41704 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181496.248296:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181496.248304:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181496.248306:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789181496.248373:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9dc1ba76aa00/2, rc 0, transno 4294967301 00000100:00100000:2.0:1789181496.248380:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1ba76aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876092510078336:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789181496.248607:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1ba768000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+13:10449:x1876092488033408:12345-192.168.204.32@tcp:44:lhsmtool_posix.0 Request processed in 38778us (39001us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181496.248616:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 80 00000020:00080000:3.0:1789181496.248768:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:3.0:1789181496.248848:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:1.0:1789181496.248958:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b67aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876092510078464:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789181496.248997:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181496.249623:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510078464 00000100:00100000:3.0:1789181496.249632:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510078464 00000100:00100000:3.0:1789181496.249736:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789181496.249747:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c065bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876092510078464:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1789181496.249895:0:6693:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1789181496.249899:0:6693:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1789181497 00002000:00010000:3.0:1789181496.249901:0:6693:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789181496.249904:0:6693:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789181497 -> 1789181497 00002000:00010000:3.0:1789181496.249906:0:6693:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1789181496.250031:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c065bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3306:x1876092510078464:12345-0@lo:2:osp-syn-1-0.0 Request processed in 285us (1032us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1789181496.250038:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:1.0:1789181496.250221:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9dc1b67aa680/2, rc 0, transno 4294967303 00000100:00100000:1.0:1789181496.250228:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b67aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876092510078464:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789181496.255604:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181496.255772:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488033536 00000100:00100000:2.0:1789181496.255783:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488033536 00000100:00100000:2.0:1789181496.255845:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 30 00000100:00100000:2.0:1789181496.255856:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b67a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+8:2353:x1876092488033536:12345-192.168.204.32@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1789181496.281476:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b67a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+8:2353:x1876092488033536:12345-192.168.204.32@tcp:16:lhsmtool_posix.0 Request processed in 25612us (25874us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181496.281490:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 30 00000001:00080000:1.0:1789181496.282393:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:1.0:1789181496.282413:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:2.0:1789181496.285034:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181496.285140:0:6887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488033792 00000100:00100000:3.0:1789181496.285151:0:6887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488033792 00000100:00100000:3.0:1789181496.285214:0:6887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 81 00000100:00100000:3.0:1789181496.285225:0:6887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1ba76a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+13:10449:x1876092488033792:12345-192.168.204.32@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789181496.285282:0:6887:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789181496.285309:0:6887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e416ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f113 expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181496.285374:0:6887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9dc18a6c2d00) 00010000:00010000:3.0:1789181496.285380:0:6887:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789181496.285413:0:6887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e4170b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181496.285427:0:6887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e4170b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181496.285438:0:6887:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e4170b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789181496.285674:0:6887:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000082230769 reply state 00000000aff8e815 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e4170b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181496.285685:0:6887:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789181496.285781:0:6887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1ba76a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+14:10449:x1876092488033792:12345-192.168.204.32@tcp:36:lhsmtool_posix.0 Request processed in 558us (757us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1789181496.285790:0:6887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 81 00010000:00010000:3.0:1789181496.289931:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e4170b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181496.289950:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e4170b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181496.289974:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e4170b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181496.289979:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1bfa1fe00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:3.0:1789181496.289985:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e4170b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181496.289992:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e4170b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181496.290009:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9dc18a6c2d00) 00010000:00010000:3.0:1789181496.290013:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181496.290018:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e4170b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181496.290024:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e4170b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181496.290177:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181496.290236:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488033920 00000100:00100000:3.0:1789181496.290245:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488033920 00000100:00100000:3.0:1789181496.290297:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 31 00000100:00100000:3.0:1789181496.290306:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1ba768e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+6:2354:x1876092488033920:12345-192.168.204.32@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789181496.290578:0:6693:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1789181496.290582:0:6693:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1789181497 -> 1789181495 00002000:00010000:3.0:1789181496.290585:0:6693:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1789181494 00002000:00010000:3.0:1789181496.290587:0:6693:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789181497 -> 1789181495 00002000:00010000:3.0:1789181496.290589:0:6693:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1789181496.290647:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1ba768e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+7:2354:x1876092488033920:12345-192.168.204.32@tcp:2:lhsmtool_posix.0 Request processed in 341us (482us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1789181496.290662:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 31 00000100:00100000:2.0:1789181496.292702:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181496.292794:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488034176 00000100:00100000:3.0:1789181496.293046:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488034176 00000100:00100000:3.0:1789181496.293230:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 82 00000100:00100000:3.0:1789181496.293244:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1ba76b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+13:10449:x1876092488034176:12345-192.168.204.32@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789181496.293307:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e41712 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181496.293324:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e416cc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f105 expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181496.293422:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e41712 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181496.293459:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e416cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f105 expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181496.293473:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e416cc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f105 expref: 13 pid: 5843 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181496.293489:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b67a9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1876092510078592:192.168.204.32@tcp:104: 00000100:00100000:3.0:1789181496.293576:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1aa4c7a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789181496.295245:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b67a9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1876092510078592:192.168.204.32@tcp:104: 00010000:00010000:3.0:1789181496.295272:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e41712 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181496.296019:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181496.298723:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488034304 00000100:00100000:0.0:1789181496.298737:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488034304 00010000:00010000:0.0:1789181496.298783:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e416cc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f105 expref: 14 pid: 5843 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181496.298827:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 43 00000100:00100000:0.0:1789181496.298837:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1ba768a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+14:2353:x1876092488034304:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789181496.298869:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789181496.298877:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e416cc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f105 expref: 14 pid: 5843 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181496.298890:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e416cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f105 expref: 14 pid: 5843 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181496.298912:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e416cc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f105 expref: 14 pid: 5843 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181496.298929:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9dc18a6c2d00) 00010000:00010000:0.0:1789181496.298935:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e41712 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181496.298945:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e41712 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181496.298952:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e41712 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181496.298987:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789181496.299049:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1ba768a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+13:2353:x1876092488034304:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 213us (3031us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181496.299056:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 43 00010000:00010000:3.0:1789181496.299126:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e41712 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181496.299141:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e41712 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181496.299171:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e41712 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181496.299178:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e41712 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181496.299184:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e41712 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181496.299190:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1bfa1f000 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:3.0:1789181496.299194:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e41712 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181496.299200:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e41712 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181496.299210:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9dc18a6c2d00) 00010000:00010000:3.0:1789181496.299213:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789181496.299217:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e41712 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181496.299223:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e41712 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181496.299277:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1ba76b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+12:10449:x1876092488034176:12345-192.168.204.32@tcp:55:lhsmtool_posix.0 Request processed in 6036us (6582us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789181496.299284:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 82 00000100:00100000:2.0:1789181496.303001:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181496.303143:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488034432 00000100:00100000:3.0:1789181496.303152:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488034432 00000100:00100000:3.0:1789181496.303224:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 32 00000100:00100000:3.0:1789181496.303235:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c02cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+7:2353:x1876092488034432:12345-192.168.204.32@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789181496.303279:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000004a739ef0/0x8f4f7840b2e41719 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181496.303297:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ad75d4d4/0x8f4f7840b2e416fd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f121 expref: 7 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181496.303306:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789181496.303310:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789181496.303315:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004a739ef0/0x8f4f7840b2e41719 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181496.303417:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ad75d4d4/0x8f4f7840b2e416fd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f121 expref: 7 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181496.303450:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ad75d4d4/0x8f4f7840b2e416fd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f121 expref: 7 pid: 6691 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181496.303467:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b67a9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6691:1876092510078720:192.168.204.32@tcp:104: 00000100:00100000:2.0:1789181496.303544:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1aa4c7a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789181496.305698:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b67a9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6691:1876092510078720:192.168.204.32@tcp:104: 00010000:00010000:0.0:1789181496.305727:0:6691:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004a739ef0/0x8f4f7840b2e41719 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181496.313713:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181496.313852:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488034560 00000100:00100000:1.0:1789181496.313864:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488034560 00010000:00010000:1.0:1789181496.313907:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ad75d4d4/0x8f4f7840b2e416fd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f121 expref: 8 pid: 6691 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181496.313956:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 44 00000100:00100000:1.0:1789181496.313966:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1ba76ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+8:2353:x1876092488034560:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789181496.313980:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789181496.314007:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ad75d4d4/0x8f4f7840b2e416fd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f121 expref: 8 pid: 6691 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181496.314021:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ad75d4d4/0x8f4f7840b2e416fd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f121 expref: 8 pid: 6691 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181496.314046:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ad75d4d4/0x8f4f7840b2e416fd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f121 expref: 8 pid: 6691 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181496.314063:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789181496.314068:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789181496.314074:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004a739ef0/0x8f4f7840b2e41719 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181496.314083:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004a739ef0/0x8f4f7840b2e41719 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181496.314146:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789181496.314202:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1ba76ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+7:2353:x1876092488034560:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 237us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181496.314210:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 44 00010000:00010000:2.0:1789181496.314211:0:6691:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004a739ef0/0x8f4f7840b2e41719 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181496.314220:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004a739ef0/0x8f4f7840b2e41719 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181496.314251:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000004a739ef0/0x8f4f7840b2e41719 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181496.314259:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004a739ef0/0x8f4f7840b2e41719 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181496.314266:0:6691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004a739ef0/0x8f4f7840b2e41719 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181496.314273:0:6691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1bfa1fe00 already unused, calling callback (ffffffffc152f9b0) 00010000:00010000:2.0:1789181496.314277:0:6691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004a739ef0/0x8f4f7840b2e41719 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181496.314285:0:6691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004a739ef0/0x8f4f7840b2e41719 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181496.314298:0:6691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004a739ef0/0x8f4f7840b2e41719 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181496.314305:0:6691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004a739ef0/0x8f4f7840b2e41719 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181496.314389:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c02cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+6:2353:x1876092488034432:12345-192.168.204.32@tcp:1:lhsmtool_posix.0 Request processed in 11157us (11398us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181496.314397:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 32 00000100:00100000:2.0:1789181496.317544:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181496.317694:0:6887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488034816 00000100:00100000:3.0:1789181496.317703:0:6887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488034816 00000100:00100000:3.0:1789181496.317768:0:6887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 83 00000100:00100000:3.0:1789181496.317780:0:6887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1ba768700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+12:10449:x1876092488034816:12345-192.168.204.32@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789181496.317862:0:6887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e41720 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181496.317881:0:6887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e41720 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181496.317893:0:6887:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e41720 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181496.318130:0:6887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e41727 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181496.318155:0:6887:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784000/0x8f4f7840b2e416da lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f10c expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181496.318163:0:6887:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e41727 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181496.318196:0:6887:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784000/0x8f4f7840b2e416da lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f10c expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181496.318209:0:6887:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784000/0x8f4f7840b2e416da lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f10c expref: 13 pid: 5843 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181496.318222:0:6887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b67aad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6887:1876092510078848:192.168.204.32@tcp:104: 00000100:00100000:3.0:1789181496.318297:0:6887:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1aa4c7a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789181496.321289:0:6887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b67aad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6887:1876092510078848:192.168.204.32@tcp:104: 00010000:00010000:2.0:1789181496.321328:0:6887:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e41727 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181496.325666:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181496.325895:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488034944 00000100:00100000:0.0:1789181496.325905:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488034944 00010000:00010000:0.0:1789181496.325945:0:6707:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784000/0x8f4f7840b2e416da lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f10c expref: 14 pid: 5843 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181496.325989:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 45 00000100:00100000:0.0:1789181496.325999:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b67aad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+14:2354:x1876092488034944:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789181496.326013:0:6707:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789181496.326020:0:6707:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784000/0x8f4f7840b2e416da lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f10c expref: 14 pid: 5843 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181496.326033:0:6707:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784000/0x8f4f7840b2e416da lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f10c expref: 14 pid: 5843 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181496.326052:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784000/0x8f4f7840b2e416da lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f10c expref: 14 pid: 5843 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181496.326064:0:6707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9dc18a6c2d00) 00010000:00010000:0.0:1789181496.326069:0:6707:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e41727 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181496.326077:0:6707:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e41727 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181496.326085:0:6707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e41727 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181496.326148:0:6707:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789181496.326200:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b67aad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+13:2354:x1876092488034944:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 203us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181496.326208:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 45 00010000:00010000:2.0:1789181496.327310:0:6887:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e41727 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181496.327325:0:6887:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e41727 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789181496.327536:0:6887:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:2.0:1789181496.327843:0:6887:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:2.0:1789181496.327895:0:6887:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:2.0:1789181496.327992:0:6887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1ba76b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6887:1876092510078976:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789181496.328072:0:6887:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181496.328171:0:6887:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc189899840 going to sleep for 11 seconds 00000100:00100000:0.0:1789181496.328464:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510078976 00000100:00100000:0.0:1789181496.328472:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510078976 00000100:00100000:1.0:1789181496.328568:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789181496.328581:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1ba76b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6887:x1876092510078976:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789181496.328703:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1ba76b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6887:x1876092510078976:12345-0@lo:1000:mdt00_003.0 Request processed in 124us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181496.328711:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789181496.328764:0:6887:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:2.0:1789181496.328769:0:6887:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9dc1b67aa680, transno 4294967303 00000100:00100000:2.0:1789181496.328814:0:6887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1ba76b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6887:1876092510078976:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1789181496.329269:0:6887:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:2.0:1789181496.329649:0:6887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1ba76b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6887:1876092510079104:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789181496.329686:0:6887:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181496.329707:0:6887:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1898993c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789181496.329982:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510079104 00000100:00100000:0.0:1789181496.329990:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510079104 00000100:00100000:0.0:1789181496.330037:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789181496.330045:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1ba768e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6887:x1876092510079104:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789181496.330232:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1ba768e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6887:x1876092510079104:12345-0@lo:1000:mdt00_003.0 Request processed in 188us (545us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1789181496.330240:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789181496.330280:0:6887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1ba76b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6887:1876092510079104:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1789181496.330324:0:6887:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e41727 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181496.330445:0:6887:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e41727 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181496.330463:0:6887:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e41727 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181496.330469:0:6887:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1bfa1f000 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:2.0:1789181496.330474:0:6887:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e41727 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181496.330482:0:6887:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e41727 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181496.330498:0:6887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9dc18a6c2d00) 00010000:00010000:2.0:1789181496.330501:0:6887:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789181496.330506:0:6887:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e41727 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181496.330512:0:6887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e41727 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181496.330548:0:6887:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ea00/0x8f4f7840b2e41655 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181496.330555:0:6887:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ea00/0x8f4f7840b2e41655 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181496.330560:0:6887:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ea00/0x8f4f7840b2e41655 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181496.330564:0:6887:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1bfa1ea00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:2.0:1789181496.330567:0:6887:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ea00/0x8f4f7840b2e41655 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181496.330582:0:6887:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ea00/0x8f4f7840b2e41655 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181496.330590:0:6887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9dc192187800) 00010000:00010000:2.0:1789181496.330592:0:6887:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789181496.330596:0:6887:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ea00/0x8f4f7840b2e41655 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181496.330601:0:6887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ea00/0x8f4f7840b2e41655 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181496.330628:0:6887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785a00/0x8f4f7840b2e4172e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181496.330643:0:6887:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891c00/0x8f4f7840b2e41671 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f0f0 expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181496.330652:0:6887:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785a00/0x8f4f7840b2e4172e lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181496.330680:0:6887:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891c00/0x8f4f7840b2e41671 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f0f0 expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181496.330696:0:6887:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891c00/0x8f4f7840b2e41671 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f0f0 expref: 16 pid: 5842 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181496.330708:0:6887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1ba769c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6887:1876092510079232:192.168.204.32@tcp:104: 00000100:00100000:2.0:1789181496.330779:0:6887:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1898993c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789181496.333480:0:6887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1ba769c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6887:1876092510079232:192.168.204.32@tcp:104: 00010000:00010000:2.0:1789181496.333524:0:6887:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785a00/0x8f4f7840b2e4172e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181496.334692:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181496.334892:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488035072 00000100:00100000:0.0:1789181496.334900:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488035072 00010000:00010000:0.0:1789181496.334948:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891c00/0x8f4f7840b2e41671 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f0f0 expref: 17 pid: 5842 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181496.335053:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 46 00000100:00100000:1.0:1789181496.335066:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1ba769c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+17:2353:x1876092488035072:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789181496.335080:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789181496.335087:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891c00/0x8f4f7840b2e41671 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f0f0 expref: 17 pid: 5842 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181496.335100:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891c00/0x8f4f7840b2e41671 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f0f0 expref: 17 pid: 5842 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181496.335253:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891c00/0x8f4f7840b2e41671 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f0f0 expref: 17 pid: 5842 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181496.335269:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9dc192187800) 00010000:00010000:1.0:1789181496.335274:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785a00/0x8f4f7840b2e4172e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181496.335298:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785a00/0x8f4f7840b2e4172e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181496.335305:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785a00/0x8f4f7840b2e4172e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181496.335361:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789181496.335381:0:6887:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785a00/0x8f4f7840b2e4172e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181496.335388:0:6887:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785a00/0x8f4f7840b2e4172e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181496.335399:0:6887:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785a00/0x8f4f7840b2e4172e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181496.335406:0:6887:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785a00/0x8f4f7840b2e4172e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181496.335413:0:6887:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785a00/0x8f4f7840b2e4172e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181496.335414:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1ba769c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+16:2353:x1876092488035072:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 351us (727us total) trans 0 rc 0/0 00010000:00010000:2.0:1789181496.335419:0:6887:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1ba785a00 already unused, calling callback (ffffffffc1f6c4f0) 00000100:00100000:1.0:1789181496.335421:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 46 00010000:00010000:2.0:1789181496.335423:0:6887:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785a00/0x8f4f7840b2e4172e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181496.335430:0:6887:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785a00/0x8f4f7840b2e4172e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181496.335439:0:6887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9dc192187800) 00010000:00010000:2.0:1789181496.335442:0:6887:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789181496.335445:0:6887:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785a00/0x8f4f7840b2e4172e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181496.335451:0:6887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785a00/0x8f4f7840b2e4172e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181496.335472:0:6887:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e41720 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181496.335477:0:6887:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e41720 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181496.335483:0:6887:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e41720 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181496.335488:0:6887:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1bfa1fa00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:2.0:1789181496.335491:0:6887:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e41720 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181496.335498:0:6887:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e41720 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181496.335506:0:6887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9dc192187800) 00010000:00010000:2.0:1789181496.335509:0:6887:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789181496.335511:0:6887:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e41720 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181496.335517:0:6887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e41720 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181496.335721:0:6887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1ba768700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+15:10449:x1876092488034816:12345-192.168.204.32@tcp:57:lhsmtool_posix.0 Request processed in 17943us (18186us total) trans 4294967360 rc 0/0 00000100:00100000:2.0:1789181496.335731:0:6887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 83 00000020:00080000:2.0:1789181496.335734:0:6887:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789181496.336295:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789181496.336300:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789181496.336477:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1789181496.336484:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789181496.338815:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181496.338901:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488035328 00000100:00100000:0.0:1789181496.338910:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488035328 00000100:00100000:0.0:1789181496.338995:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 20 00000100:00100000:0.0:1789181496.339005:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1ba76bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+15:10449:x1876092488035328:12345-192.168.204.32@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789181496.339726:0:5846:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789181496.339843:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:0.0:1789181496.339889:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891600/0x8f4f7840b2e41735 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181496.339906:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891600/0x8f4f7840b2e41735 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181496.339917:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891600/0x8f4f7840b2e41735 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181496.339926:0:5846:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891600/0x8f4f7840b2e41735 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181496.339932:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891600/0x8f4f7840b2e41735 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181496.339938:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891600/0x8f4f7840b2e41735 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181496.339960:0:5846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789181496.340041:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1ba76bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+17:10449:x1876092488035328:12345-192.168.204.32@tcp:35:lhsmtool_posix.0 Request processed in 1036us (1236us total) trans 4294967362 rc 0/0 00000100:00100000:0.0:1789181496.340049:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 20 00000020:00080000:0.0:1789181496.340054:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789181496.340136:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789181496.340150:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891600/0x8f4f7840b2e41735 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181496.340157:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc189891600 already unused, calling callback (ffffffffc152f9b0) 00010000:00010000:2.0:1789181496.340161:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891600/0x8f4f7840b2e41735 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181496.340170:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891600/0x8f4f7840b2e41735 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181496.340184:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9dc18553aa00) 00010000:00010000:2.0:1789181496.340187:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789181496.340192:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891600/0x8f4f7840b2e41735 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181496.340197:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891600/0x8f4f7840b2e41735 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181496.340216:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181496.340218:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181496.340219:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181496.895254:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789181497.805852:0:12062:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789181497.805861:0:12062:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789181497.805897:0:12062:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1789181497.805903:0:12062:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1789181497.920273:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789181497.980313:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181497.982355:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488035584 00000100:00100000:0.0:1789181497.982372:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488035584 00000100:00100000:0.0:1789181497.982462:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 84 00000100:00100000:0.0:1789181497.982475:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b67aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+17:10467:x1876092488035584:12345-192.168.204.32@tcp:101:lfs.0 00010000:00010000:0.0:1789181497.982509:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181497.982535:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891c00/0x8f4f7840b2e4173c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f128 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181497.982650:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890200/0x8f4f7840b2e41743 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181497.982667:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890200/0x8f4f7840b2e41743 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181497.982679:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890200/0x8f4f7840b2e41743 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789181497.982700:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1789181497.984284:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891c00/0x8f4f7840b2e4173c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f128 expref: 20 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181497.984308:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890200/0x8f4f7840b2e41743 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f128 expref: 19 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181497.984317:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9dc1995b7200) 00010000:00010000:0.0:1789181497.984320:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789181497.984324:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc189890200, rc 0) 00000100:00100000:0.0:1789181497.984412:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b67aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+19:10467:x1876092488035584:12345-192.168.204.32@tcp:101:lfs.0 Request processed in 1940us (4109us total) trans 4294967363 rc 0/0 00000100:00100000:0.0:1789181497.984421:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 84 00000100:00080000:0.0:1789181497.984451:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789181498.005164:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181498.013305:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488035712 00000100:00100000:0.0:1789181498.013321:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488035712 00000100:00100000:0.0:1789181498.013420:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 85 00000100:00100000:0.0:1789181498.013431:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b67ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+19:10467:x1876092488035712:12345-192.168.204.32@tcp:34:lfs.0 00010000:00010000:0.0:1789181498.013509:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891400/0x8f4f7840b2e41751 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181498.013526:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891400/0x8f4f7840b2e41751 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181498.013537:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891400/0x8f4f7840b2e41751 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181498.013551:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890600/0x8f4f7840b2e41758 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181498.013559:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890600/0x8f4f7840b2e41758 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181498.013565:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890600/0x8f4f7840b2e41758 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181498.016605:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e4175f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181498.016623:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e4175f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181498.016635:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e4175f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789181498.016681:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e4175f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181498.016706:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891400/0x8f4f7840b2e41751 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181498.016720:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891400/0x8f4f7840b2e41751 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181498.016727:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891400/0x8f4f7840b2e41751 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181498.016733:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc189891400 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:0.0:1789181498.016738:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891400/0x8f4f7840b2e41751 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181498.016746:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891400/0x8f4f7840b2e41751 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181498.016759:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9dc1995b7200) 00010000:00010000:0.0:1789181498.016762:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789181498.016767:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891400/0x8f4f7840b2e41751 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181498.016772:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891400/0x8f4f7840b2e41751 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181498.016784:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890600/0x8f4f7840b2e41758 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181498.016790:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890600/0x8f4f7840b2e41758 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181498.016796:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890600/0x8f4f7840b2e41758 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181498.016801:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc189890600 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:0.0:1789181498.016810:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890600/0x8f4f7840b2e41758 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181498.016816:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890600/0x8f4f7840b2e41758 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181498.016824:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9dc18553ae00) 00010000:00010000:0.0:1789181498.016827:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789181498.016830:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890600/0x8f4f7840b2e41758 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181498.016836:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890600/0x8f4f7840b2e41758 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181498.016850:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e4175f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181498.016856:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e4175f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181498.016862:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e4175f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181498.016868:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc189890000 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:0.0:1789181498.016871:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e4175f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181498.016877:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e4175f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181498.016884:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9dc18553ad00) 00010000:00010000:0.0:1789181498.016886:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789181498.016896:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e4175f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181498.016902:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e4175f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181498.017002:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b67ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+19:10467:x1876092488035712:12345-192.168.204.32@tcp:34:lfs.0 Request processed in 3568us (11843us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181498.017011:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 85 00000100:00100000:2.0:1789181498.099224:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181498.102151:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488035968 00000100:00100000:0.0:1789181498.102167:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488035968 00000100:00100000:0.0:1789181498.102244:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 86 00000100:00100000:0.0:1789181498.102255:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1ba769f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+19:10470:x1876092488035968:12345-192.168.204.32@tcp:101:lfs.0 00010000:00010000:0.0:1789181498.102275:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181498.102293:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e41766 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f12f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181498.102401:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890600/0x8f4f7840b2e4176d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181498.102416:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890600/0x8f4f7840b2e4176d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181498.102427:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890600/0x8f4f7840b2e4176d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181498.102440:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891400/0x8f4f7840b2e41774 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181498.102448:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891400/0x8f4f7840b2e41774 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181498.102472:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891400/0x8f4f7840b2e41774 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181498.102713:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891c00/0x8f4f7840b2e4177b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181498.102721:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891c00/0x8f4f7840b2e4177b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181498.102728:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891c00/0x8f4f7840b2e4177b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789181498.102737:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1789181498.103209:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890600/0x8f4f7840b2e4176d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181498.103219:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890600/0x8f4f7840b2e4176d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181498.103227:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890600/0x8f4f7840b2e4176d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181498.103232:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc189890600 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:0.0:1789181498.103236:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890600/0x8f4f7840b2e4176d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181498.103243:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890600/0x8f4f7840b2e4176d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181498.103254:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9dc1995b7200) 00010000:00010000:0.0:1789181498.103257:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789181498.103270:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890600/0x8f4f7840b2e4176d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181498.103276:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890600/0x8f4f7840b2e4176d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181498.103289:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891400/0x8f4f7840b2e41774 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181498.103295:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891400/0x8f4f7840b2e41774 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181498.103300:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891400/0x8f4f7840b2e41774 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181498.103305:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc189891400 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:0.0:1789181498.103308:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891400/0x8f4f7840b2e41774 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181498.103313:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891400/0x8f4f7840b2e41774 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181498.103321:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9dc18553ad00) 00010000:00010000:0.0:1789181498.103323:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789181498.103326:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891400/0x8f4f7840b2e41774 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181498.103376:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891400/0x8f4f7840b2e41774 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181498.103419:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e41766 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f12f expref: 22 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181498.103445:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891c00/0x8f4f7840b2e4177b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f12f expref: 21 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181498.103452:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9dc18553ae00) 00010000:00010000:0.0:1789181498.103455:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789181498.103457:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc189891c00, rc 0) 00000100:00100000:0.0:1789181498.103522:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1ba769f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+21:10470:x1876092488035968:12345-192.168.204.32@tcp:101:lfs.0 Request processed in 1268us (4308us total) trans 4294967364 rc 0/0 00000100:00100000:0.0:1789181498.103529:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 86 00000100:00100000:0.0:1789181498.113088:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181498.114239:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488036096 00000100:00100000:2.0:1789181498.114252:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488036096 00000100:00100000:2.0:1789181498.114318:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 87 00000100:00100000:2.0:1789181498.114346:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6b51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+21:10470:x1876092488036096:12345-192.168.204.32@tcp:54:lfs.0 00010000:00010000:2.0:1789181498.114418:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784000/0x8f4f7840b2e41789 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.114437:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784000/0x8f4f7840b2e41789 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.114467:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784000/0x8f4f7840b2e41789 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.114494:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784000/0x8f4f7840b2e41789 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.114502:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784000/0x8f4f7840b2e41789 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.114509:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784000/0x8f4f7840b2e41789 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.114515:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1ba784000 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:2.0:1789181498.114520:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784000/0x8f4f7840b2e41789 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.114528:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784000/0x8f4f7840b2e41789 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.114541:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9dc18553ae00) 00010000:00010000:2.0:1789181498.114544:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789181498.114549:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784000/0x8f4f7840b2e41789 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.114555:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784000/0x8f4f7840b2e41789 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181498.114649:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6b51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+21:10470:x1876092488036096:12345-192.168.204.32@tcp:54:lfs.0 Request processed in 321us (1580us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181498.114657:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 87 00000100:00100000:1.0:1789181498.117488:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181498.117696:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488036352 00000100:00100000:2.0:1789181498.117717:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488036352 00000100:00100000:2.0:1789181498.117778:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 21 00000100:00100000:2.0:1789181498.117789:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19928fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+21:10470:x1876092488036352:12345-192.168.204.32@tcp:35:lfs.0 00000100:00100000:2.0:1789181498.118037:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19928fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+22:10470:x1876092488036352:12345-192.168.204.32@tcp:35:lfs.0 Request processed in 250us (560us total) trans 4294967365 rc 0/0 00000100:00100000:2.0:1789181498.118046:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 21 00000100:00100000:0.0:1789181498.180716:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181498.181034:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488036608 00000100:00100000:2.0:1789181498.181045:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488036608 00000100:00100000:2.0:1789181498.181125:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 88 00000100:00100000:2.0:1789181498.181136:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6b50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+22:9989:x1876092488036608:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:2.0:1789181498.181161:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181498.181183:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784000/0x8f4f7840b2e41790 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f136 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.181295:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784200/0x8f4f7840b2e41797 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.181312:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891c00/0x8f4f7840b2e4177b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f12f expref: 23 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.181321:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784200/0x8f4f7840b2e41797 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.181395:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891c00/0x8f4f7840b2e4177b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f12f expref: 23 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.181409:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891c00/0x8f4f7840b2e4177b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f12f expref: 23 pid: 5843 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181498.181445:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1ba76a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1876092510079360:192.168.204.32@tcp:104: 00000100:00100000:2.0:1789181498.181542:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc18985db40 going to sleep for 11 seconds 00000100:00100000:0.0:1789181498.185973:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181498.186237:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1ba76a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1876092510079360:192.168.204.32@tcp:104: 00010000:00010000:2.0:1789181498.186277:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784200/0x8f4f7840b2e41797 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181498.186437:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488036736 00000100:00100000:1.0:1789181498.186446:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488036736 00010000:00010000:1.0:1789181498.186486:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891c00/0x8f4f7840b2e4177b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f12f expref: 24 pid: 5843 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181498.186516:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 47 00000100:00100000:1.0:1789181498.186526:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6b50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+24:2354:x1876092488036736:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789181498.186540:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789181498.186547:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891c00/0x8f4f7840b2e4177b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f12f expref: 24 pid: 5843 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181498.186559:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891c00/0x8f4f7840b2e4177b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f12f expref: 24 pid: 5843 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181498.186580:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891c00/0x8f4f7840b2e4177b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f12f expref: 24 pid: 5843 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181498.186636:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9dc18553ae00) 00010000:00010000:1.0:1789181498.186641:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784200/0x8f4f7840b2e41797 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181498.186650:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784200/0x8f4f7840b2e41797 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181498.186657:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784200/0x8f4f7840b2e41797 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181498.186686:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789181498.186744:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6b50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+23:2354:x1876092488036736:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 219us (781us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181498.186752:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 47 00010000:00010000:2.0:1789181498.186917:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784200/0x8f4f7840b2e41797 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.186925:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784200/0x8f4f7840b2e41797 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789181498.186945:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1789181498.187726:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784000/0x8f4f7840b2e41790 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f136 expref: 24 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.187750:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784200/0x8f4f7840b2e41797 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f136 expref: 23 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.187758:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9dc18553ae00) 00010000:00010000:2.0:1789181498.187761:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789181498.187764:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1ba784200, rc 0) 00000100:00100000:2.0:1789181498.187811:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6b50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+23:9989:x1876092488036608:12345-192.168.204.32@tcp:101:bash.0 Request processed in 6677us (7105us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1789181498.187818:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 88 00000100:00100000:0.0:1789181498.191963:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181498.192577:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488036992 00000100:00100000:1.0:1789181498.192588:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488036992 00000100:00100000:1.0:1789181498.192663:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 89 00000100:00100000:1.0:1789181498.192676:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6b50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+23:9989:x1876092488036992:12345-192.168.204.32@tcp:36:bash.0 00010000:00010000:1.0:1789181498.192943:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b400/0x8f4f7840b2e417a5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181498.192962:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b400/0x8f4f7840b2e417a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181498.192974:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b400/0x8f4f7840b2e417a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789181498.193029:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:1.0:1789181498.193055:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000084b6f3fb reply state 00000000103aca98 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b400/0x8f4f7840b2e417a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181498.193090:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1789181498.193155:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:1.0:1789181498.193264:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6b50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+27:9989:x1876092488036992:12345-192.168.204.32@tcp:36:bash.0 Request processed in 590us (1311us total) trans 4294967369 rc 0/0 00000100:00100000:1.0:1789181498.193273:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 89 00000020:00080000:1.0:1789181498.193278:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1789181498.205925:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181498.206038:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488037120 00000100:00100000:0.0:1789181498.206048:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488037120 00000100:00100000:0.0:1789181498.206123:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 90 00000100:00100000:0.0:1789181498.206135:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c065b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+27:9989:x1876092488037120:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:0.0:1789181498.206163:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181498.206184:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e417ac lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f13d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181498.206245:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e417ac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f13d expref: 28 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181498.206275:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e417ac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f13d expref: 28 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181498.206317:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9dc18553ae00) 00010000:00010000:0.0:1789181498.206320:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789181498.206324:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc189890000, rc 0) 00000100:00100000:0.0:1789181498.206415:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c065b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+28:9989:x1876092488037120:12345-192.168.204.32@tcp:101:bash.0 Request processed in 282us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181498.206421:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 90 00010000:00010000:3.0:1789181498.206780:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b400/0x8f4f7840b2e417a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.206790:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b400/0x8f4f7840b2e417a5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.206798:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b400/0x8f4f7840b2e417a5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.206804:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc18151b400 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:3.0:1789181498.206809:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b400/0x8f4f7840b2e417a5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.206826:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b400/0x8f4f7840b2e417a5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.206839:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9dc18553ae00) 00010000:00010000:3.0:1789181498.206842:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181498.206846:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b400/0x8f4f7840b2e417a5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.206852:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b400/0x8f4f7840b2e417a5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181498.212248:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181498.212447:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488037248 00000100:00100000:2.0:1789181498.212470:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488037248 00000100:00080000:0.0:1789181498.212608:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789181498.213393:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 33 00000100:00100000:2.0:1789181498.213408:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b67a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+6:9989:x1876092488037248:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:2.0:1789181498.213426:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181498.213445:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cf2d2bc7/0x8f4f7840b2e417b3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f144 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789181498.213474:0:6693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aa4be37, atime: 0x6aa4be36, ctime: 0x6aa4be37, blocks: 0xb 00010000:00010000:2.0:1789181498.213495:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=390s v=(0 0) 00010000:00010000:2.0:1789181498.213500:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789181498.213508:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf2d2bc7/0x8f4f7840b2e417b3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f144 expref: 7 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.213526:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cf2d2bc7/0x8f4f7840b2e417b3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f144 expref: 7 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.213539:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1ba785e00, rc 0) 00000100:00100000:2.0:1789181498.213594:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b67a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+7:9989:x1876092488037248:12345-192.168.204.32@tcp:101:bash.0 Request processed in 190us (1356us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181498.213601:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 33 00000100:00100000:2.0:1789181498.219255:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181498.219453:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488037376 00000100:00100000:0.0:1789181498.219464:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488037376 00002000:00010000:0.0:1789181498.219507:0:6697:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:0.0:1789181498.219513:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9dc1ba76a680 with x1876092488037376 ext(0->18446744073709551615) 00002000:00010000:0.0:1789181498.219526:0:6697:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9dc1ba76a680. 00000100:00100000:0.0:1789181498.219562:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1 00000100:00100000:0.0:1789181498.219573:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1ba76a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+7:2353:x1876092488037376:12345-192.168.204.32@tcp:10:bash.0 00002000:00010000:0.0:1789181498.219869:0:6697:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1789181498.219873:0:6697:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1789181495 -> 1789181499 00002000:00010000:0.0:1789181498.219876:0:6697:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1789181494 -> 1789181494 00002000:00010000:0.0:1789181498.219878:0:6697:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789181495 -> 1789181499 00002000:00010000:0.0:1789181498.219881:0:6697:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1789181498.220095:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1ba76a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+8:2353:x1876092488037376:12345-192.168.204.32@tcp:10:bash.0 Request processed in 522us (848us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1789181498.220103:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1 00002000:00010000:0.0:1789181498.220107:0:6697:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:0.0:1789181498.220110:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9dc1ba76a680 with x1876092488037376 ext(0->18446744073709551615) 00002000:00010000:0.0:1789181498.220115:0:6697:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9dc1ba76a680. 00000100:00100000:0.0:1789181498.316314:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181498.316420:0:6887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488037504 00000100:00100000:3.0:1789181498.316430:0:6887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488037504 00000100:00100000:3.0:1789181498.316495:0:6887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 91 00000100:00100000:3.0:1789181498.316507:0:6887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6b52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+27:10484:x1876092488037504:12345-192.168.204.32@tcp:34:lfs.0 00010000:00010000:3.0:1789181498.316577:0:6887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e600/0x8f4f7840b2e417ba lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.316593:0:6887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e600/0x8f4f7840b2e417ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.316605:0:6887:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e600/0x8f4f7840b2e417ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.316619:0:6887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e800/0x8f4f7840b2e417c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.316626:0:6887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e800/0x8f4f7840b2e417c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.316662:0:6887:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e800/0x8f4f7840b2e417c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.316911:0:6887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e417c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.316920:0:6887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e417c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.316928:0:6887:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e417c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789181498.316969:0:6887:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e417c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.316982:0:6887:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e600/0x8f4f7840b2e417ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.316989:0:6887:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e600/0x8f4f7840b2e417ba lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.316996:0:6887:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e600/0x8f4f7840b2e417ba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.317001:0:6887:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1bfa1e600 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:3.0:1789181498.317006:0:6887:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e600/0x8f4f7840b2e417ba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.317014:0:6887:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e600/0x8f4f7840b2e417ba lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.317026:0:6887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9dc1995b7200) 00010000:00010000:3.0:1789181498.317036:0:6887:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181498.317042:0:6887:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e600/0x8f4f7840b2e417ba lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.317048:0:6887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e600/0x8f4f7840b2e417ba lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.317073:0:6887:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e800/0x8f4f7840b2e417c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.317080:0:6887:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e800/0x8f4f7840b2e417c1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.317086:0:6887:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e800/0x8f4f7840b2e417c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.317091:0:6887:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1bfa1e800 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:3.0:1789181498.317093:0:6887:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e800/0x8f4f7840b2e417c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.317583:0:6887:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e800/0x8f4f7840b2e417c1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.317597:0:6887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9dc192187700) 00010000:00010000:3.0:1789181498.317600:0:6887:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181498.317604:0:6887:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e800/0x8f4f7840b2e417c1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.317610:0:6887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e800/0x8f4f7840b2e417c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.317638:0:6887:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e417c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.317652:0:6887:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e417c8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.317657:0:6887:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e417c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.317671:0:6887:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1bfa1ee00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:3.0:1789181498.317674:0:6887:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e417c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.317680:0:6887:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e417c8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.317688:0:6887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9dc18553ae00) 00010000:00010000:3.0:1789181498.317690:0:6887:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181498.317694:0:6887:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e417c8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.317699:0:6887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e417c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181498.317786:0:6887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6b52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+27:10484:x1876092488037504:12345-192.168.204.32@tcp:34:lfs.0 Request processed in 1280us (1480us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181498.317802:0:6887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 91 00000100:00100000:3.0:1789181498.352519:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181498.352596:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488037760 00000100:00100000:2.0:1789181498.352607:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488037760 00000100:00100000:2.0:1789181498.352675:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 92 00000100:00100000:2.0:1789181498.352687:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b67a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+27:10487:x1876092488037760:12345-192.168.204.32@tcp:101:lfs.0 00010000:00010000:2.0:1789181498.352709:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181498.352748:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e417cf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f14b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.352844:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785400/0x8f4f7840b2e417d6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.352859:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785400/0x8f4f7840b2e417d6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.352871:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785400/0x8f4f7840b2e417d6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.352885:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785600/0x8f4f7840b2e417dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.352892:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785600/0x8f4f7840b2e417dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.352897:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785600/0x8f4f7840b2e417dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.353484:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784000/0x8f4f7840b2e417e4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.353497:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784000/0x8f4f7840b2e417e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.353505:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784000/0x8f4f7840b2e417e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789181498.353516:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789181498.353618:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785400/0x8f4f7840b2e417d6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.353636:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785400/0x8f4f7840b2e417d6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.353642:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785400/0x8f4f7840b2e417d6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.353648:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1ba785400 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:2.0:1789181498.353652:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785400/0x8f4f7840b2e417d6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.353660:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785400/0x8f4f7840b2e417d6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.353686:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9dc1995b7200) 00010000:00010000:2.0:1789181498.353690:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789181498.353695:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785400/0x8f4f7840b2e417d6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.353701:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785400/0x8f4f7840b2e417d6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.353719:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785600/0x8f4f7840b2e417dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.353725:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785600/0x8f4f7840b2e417dd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.353731:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785600/0x8f4f7840b2e417dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.353735:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1ba785600 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:2.0:1789181498.353745:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785600/0x8f4f7840b2e417dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.353752:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785600/0x8f4f7840b2e417dd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.353760:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9dc1995b7500) 00010000:00010000:2.0:1789181498.353762:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789181498.353765:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785600/0x8f4f7840b2e417dd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.353771:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785600/0x8f4f7840b2e417dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.353815:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e417cf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f14b expref: 30 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.353837:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784000/0x8f4f7840b2e417e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f14b expref: 29 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.353844:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9dc18553ae00) 00010000:00010000:2.0:1789181498.353846:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789181498.353849:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1ba784000, rc 0) 00000100:00100000:2.0:1789181498.353963:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b67a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+29:10487:x1876092488037760:12345-192.168.204.32@tcp:101:lfs.0 Request processed in 1278us (1453us total) trans 4294967370 rc 0/0 00000100:00100000:2.0:1789181498.353972:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 92 00000100:00100000:2.0:1789181498.356093:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181498.356795:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488037888 00000100:00100000:1.0:1789181498.356806:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488037888 00000100:00100000:1.0:1789181498.356875:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 93 00000100:00100000:1.0:1789181498.356885:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1ba76bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+29:10487:x1876092488037888:12345-192.168.204.32@tcp:54:lfs.0 00010000:00010000:1.0:1789181498.356948:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b600/0x8f4f7840b2e417f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181498.356965:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784200/0x8f4f7840b2e41797 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f136 expref: 29 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181498.356973:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b600/0x8f4f7840b2e417f2 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181498.357007:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784200/0x8f4f7840b2e41797 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f136 expref: 29 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181498.357020:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784200/0x8f4f7840b2e41797 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f136 expref: 29 pid: 5843 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181498.357033:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c0659880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1876092510079488:192.168.204.32@tcp:104: 00000100:00100000:1.0:1789181498.357240:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1a72fab40 going to sleep for 11 seconds 00000100:00100000:2.0:1789181498.360504:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c0659880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1876092510079488:192.168.204.32@tcp:104: 00010000:00010000:2.0:1789181498.360537:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b600/0x8f4f7840b2e417f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181498.361263:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181498.361362:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488038144 00000100:00100000:1.0:1789181498.361370:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488038144 00000100:00100000:1.0:1789181498.361465:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 22 00000100:00100000:1.0:1789181498.361476:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1ba769880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+30:5591:x1876092488038144:12345-192.168.204.32@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789181498.361799:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1ba769880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+31:5591:x1876092488038144:12345-192.168.204.32@tcp:35:ldlm_bl.0 Request processed in 325us (537us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1789181498.361807:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 22 00000100:00100000:0.0:1789181498.364234:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181498.364324:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488038272 00000100:00100000:1.0:1789181498.364357:0:8456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488038272 00010000:00010000:1.0:1789181498.364395:0:8456:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784200/0x8f4f7840b2e41797 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f136 expref: 31 pid: 5843 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181498.364426:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 48 00000100:00100000:1.0:1789181498.364435:0:8456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6b51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5971a429-48ca-4c07-88a3-fa58102a53bc+31:2354:x1876092488038272:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789181498.364449:0:8456:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789181498.364456:0:8456:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784200/0x8f4f7840b2e41797 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f136 expref: 31 pid: 5843 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181498.364468:0:8456:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784200/0x8f4f7840b2e41797 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f136 expref: 31 pid: 5843 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181498.364488:0:8456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784200/0x8f4f7840b2e41797 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f136 expref: 31 pid: 5843 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181498.364505:0:8456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9dc18553ae00) 00010000:00010000:1.0:1789181498.364523:0:8456:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b600/0x8f4f7840b2e417f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181498.364535:0:8456:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b600/0x8f4f7840b2e417f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181498.364543:0:8456:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b600/0x8f4f7840b2e417f2 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181498.364679:0:8456:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789181498.364735:0:8456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6b51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5971a429-48ca-4c07-88a3-fa58102a53bc+30:2354:x1876092488038272:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 300us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181498.364742:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 48 00010000:00010000:2.0:1789181498.366003:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b600/0x8f4f7840b2e417f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.366023:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b600/0x8f4f7840b2e417f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.366053:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b600/0x8f4f7840b2e417f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.366061:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b600/0x8f4f7840b2e417f2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.366079:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b600/0x8f4f7840b2e417f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.366085:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc18151b600 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:2.0:1789181498.366090:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b600/0x8f4f7840b2e417f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.366098:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b600/0x8f4f7840b2e417f2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.366219:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9dc18553ae00) 00010000:00010000:2.0:1789181498.366222:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789181498.366227:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b600/0x8f4f7840b2e417f2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.366233:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b600/0x8f4f7840b2e417f2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181498.366442:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1ba76bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+29:10487:x1876092488037888:12345-192.168.204.32@tcp:54:lfs.0 Request processed in 9554us (10354us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181498.366451:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 93 00000040:00080000:1.0:1789181498.369059:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789181498.369080:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789181498.369125:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1789181498.369132:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789181498.369495:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1ba768380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876092510079616:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789181498.369552:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181498.369642:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510079616 00000100:00100000:1.0:1789181498.369649:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510079616 00000100:00100000:1.0:1789181498.369716:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789181498.369726:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6b53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1876092510079616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789181498.369758:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789181498.369804:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6b53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1876092510079616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181498.369811:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:0.0:1789181498.369991:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789181498.370028:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1ba768380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876092510079616:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789181498.370548:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181498.370752:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488038528 00000100:00100000:3.0:1789181498.370758:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488038528 00000100:00100000:3.0:1789181498.370829:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 23 00000100:00100000:3.0:1789181498.370839:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6b51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+29:10487:x1876092488038528:12345-192.168.204.32@tcp:35:lfs.0 00000100:00100000:3.0:1789181498.371056:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6b51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+30:10487:x1876092488038528:12345-192.168.204.32@tcp:35:lfs.0 Request processed in 219us (509us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1789181498.371073:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 23 00000100:00100000:0.0:1789181498.455017:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181498.455072:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181498.455157:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488038784 00000100:00100000:2.0:1789181498.455166:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488038784 00000100:00100000:2.0:1789181498.455220:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 34 00000100:00100000:2.0:1789181498.455229:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1a730a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+8:2351:x1876092488038784:12345-192.168.204.32@tcp:16:kworker.0 00000100:00100000:1.0:1789181498.455359:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488038656 00000100:00100000:1.0:1789181498.455364:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488038656 00002000:00100000:1.0:1789181498.455390:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->7) req@ffff9dc1a730b100 x1876092488038656/t0(0) o4->5971a429-48ca-4c07-88a3-fa58102a53bc@192.168.204.32@tcp:629/0 lens 496/0 e 0 to 0 dl 1789181509 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789181498.455413:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9dc1a730b100 with x1876092488038656 ext(0->7) 00002000:00010000:1.0:1789181498.455419:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9dc1a730b100 00000100:00100000:1.0:1789181498.455447:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2 00000100:00100000:1.0:1789181498.455456:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1a730b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+9:2351:x1876092488038656:12345-192.168.204.32@tcp:4:bash.0 00000100:00100000:1.0:1789181498.456043:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1a730b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+11:2351:x1876092488038656:12345-192.168.204.32@tcp:4:bash.0 Request processed in 587us (1034us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1789181498.456052:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2 00002000:00100000:1.0:1789181498.456059:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->7) req@ffff9dc1a730b100 x1876092488038656/t4294967307(0) o4->5971a429-48ca-4c07-88a3-fa58102a53bc@192.168.204.32@tcp:629/0 lens 496/448 e 0 to 0 dl 1789181509 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789181498.456079:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9dc1a730b100 with x1876092488038656 ext(0->7) 00002000:00010000:1.0:1789181498.456083:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9dc1a730b100 00000100:00100000:2.0:1789181498.463500:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181498.463579:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488039040 00000100:00100000:3.0:1789181498.463589:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488039040 00000100:00100000:3.0:1789181498.463649:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 94 00000100:00100000:3.0:1789181498.463670:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1ba768380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+30:10498:x1876092488039040:12345-192.168.204.32@tcp:101:cat.0 00010000:00010000:3.0:1789181498.463695:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181498.463715:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e417f9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f152 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.463788:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e800/0x8f4f7840b2e41800 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.463804:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e800/0x8f4f7840b2e41800 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.463817:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e800/0x8f4f7840b2e41800 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.463832:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e600/0x8f4f7840b2e41807 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.463839:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e600/0x8f4f7840b2e41807 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.463845:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e600/0x8f4f7840b2e41807 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.464109:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e4180e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.464128:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e4180e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.464135:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e4180e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789181498.464146:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:3.0:1789181498.464235:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e800/0x8f4f7840b2e41800 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.464242:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e800/0x8f4f7840b2e41800 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.464249:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e800/0x8f4f7840b2e41800 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.464254:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1bfa1e800 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:3.0:1789181498.464259:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e800/0x8f4f7840b2e41800 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.464267:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e800/0x8f4f7840b2e41800 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.464280:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9dc1995b7200) 00010000:00010000:3.0:1789181498.464283:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181498.464288:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e800/0x8f4f7840b2e41800 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.464293:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e800/0x8f4f7840b2e41800 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.464306:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e600/0x8f4f7840b2e41807 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.464318:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e600/0x8f4f7840b2e41807 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.464324:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e600/0x8f4f7840b2e41807 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.464359:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1bfa1e600 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:3.0:1789181498.464363:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e600/0x8f4f7840b2e41807 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.464369:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e600/0x8f4f7840b2e41807 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.464378:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9dc192187c00) 00010000:00010000:3.0:1789181498.464381:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181498.464384:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e600/0x8f4f7840b2e41807 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.464389:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e600/0x8f4f7840b2e41807 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.464432:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e417f9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f152 expref: 33 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.464446:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e4180e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f152 expref: 32 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.464453:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9dc18553ae00) 00010000:00010000:3.0:1789181498.464456:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789181498.464465:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1bfa1fa00, rc 0) 00000100:00100000:3.0:1789181498.464524:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1ba768380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+32:10498:x1876092488039040:12345-192.168.204.32@tcp:101:cat.0 Request processed in 865us (1032us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1789181498.464532:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 94 00000100:00100000:2.0:1789181498.470130:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181498.470769:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488039296 00000100:00100000:0.0:1789181498.470781:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488039296 00000100:00100000:0.0:1789181498.470834:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 24 00000100:00100000:0.0:1789181498.470845:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+32:10498:x1876092488039296:12345-192.168.204.32@tcp:35:cat.0 00000100:00100000:0.0:1789181498.471084:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+33:10498:x1876092488039296:12345-192.168.204.32@tcp:35:cat.0 Request processed in 241us (962us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1789181498.471092:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 24 00000100:00100000:2.0:1789181498.485456:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1a730a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+10:2351:x1876092488038784:12345-192.168.204.32@tcp:16:kworker.0 Request processed in 30218us (30384us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181498.485468:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 34 00000001:00080000:1.0:1789181498.486015:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:1.0:1789181498.486026:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:1.0:1789181498.486033:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000100:00100000:2.0:1789181498.516143:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181498.525907:0:6887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488039552 00000100:00100000:3.0:1789181498.525924:0:6887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488039552 00000100:00100000:3.0:1789181498.525999:0:6887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 95 00000100:00100000:3.0:1789181498.526011:0:6887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b66f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+33:10499:x1876092488039552:12345-192.168.204.32@tcp:36:rm.0 00010000:00010000:3.0:1789181498.526084:0:6887:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789181498.526112:0:6887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e4180e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f152 expref: 33 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.526138:0:6887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784000/0x8f4f7840b2e417e4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f14b expref: 32 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.526153:0:6887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e417ac lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f13d expref: 31 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.526163:0:6887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9dc18553ae00) 00010000:00010000:3.0:1789181498.526173:0:6887:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789181498.526322:0:6887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e4181c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.526373:0:6887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e4181c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.526384:0:6887:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e4181c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.526417:0:6887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e600/0x8f4f7840b2e41823 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.526425:0:6887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e600/0x8f4f7840b2e41823 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.526432:0:6887:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e600/0x8f4f7840b2e41823 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.528792:0:6887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e800/0x8f4f7840b2e4182a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.528815:0:6887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e800/0x8f4f7840b2e4182a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.528828:0:6887:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e800/0x8f4f7840b2e4182a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789181498.529616:0:6887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:3.0:1789181498.529627:0:6887:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 390786295911ns, next at 391786293766ns, rc = 0 00010000:00010000:3.0:1789181498.530326:0:6887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ea00/0x8f4f7840b2e41831 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.530374:0:6887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ea00/0x8f4f7840b2e41831 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.530384:0:6887:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ea00/0x8f4f7840b2e41831 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.530392:0:6887:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ea00/0x8f4f7840b2e41831 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.530410:0:6887:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ea00/0x8f4f7840b2e41831 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.530416:0:6887:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ea00/0x8f4f7840b2e41831 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.530491:0:6887:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789181498.530514:0:6887:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e800/0x8f4f7840b2e4182a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.530520:0:6887:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e800/0x8f4f7840b2e4182a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.530526:0:6887:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e800/0x8f4f7840b2e4182a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.530532:0:6887:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1bfa1e800 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:3.0:1789181498.530536:0:6887:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e800/0x8f4f7840b2e4182a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.530544:0:6887:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e800/0x8f4f7840b2e4182a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.530556:0:6887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9dc192187700) 00010000:00010000:3.0:1789181498.530559:0:6887:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789181498.530564:0:6887:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e800/0x8f4f7840b2e4182a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.530570:0:6887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e800/0x8f4f7840b2e4182a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.530588:0:6887:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e4181c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.530603:0:6887:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e4181c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.530609:0:6887:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e4181c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.530614:0:6887:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1bfa1ee00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:3.0:1789181498.530617:0:6887:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e4181c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.530623:0:6887:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e4181c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.530631:0:6887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9dc1995b7200) 00010000:00010000:3.0:1789181498.530633:0:6887:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181498.530636:0:6887:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e4181c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.530641:0:6887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e4181c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789181498.530653:0:6887:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000340fb67 reply state 000000000bed45f6 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e600/0x8f4f7840b2e41823 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181498.530736:0:6887:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789181498.530829:0:6887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b66f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+32:10499:x1876092488039552:12345-192.168.204.32@tcp:36:rm.0 Request processed in 4816us (14691us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1789181498.530839:0:6887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 95 00010000:00010000:2.0:1789181498.539306:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789181498.539320:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ea00/0x8f4f7840b2e41831 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.539345:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1bfa1ea00 already unused, calling callback (ffffffffc152f9b0) 00010000:00010000:2.0:1789181498.539350:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ea00/0x8f4f7840b2e41831 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.539361:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ea00/0x8f4f7840b2e41831 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.539380:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9dc192187700) 00010000:00010000:2.0:1789181498.539383:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789181498.539388:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ea00/0x8f4f7840b2e41831 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.539412:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ea00/0x8f4f7840b2e41831 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.539441:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181498.539443:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181498.539445:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181498.541212:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e600/0x8f4f7840b2e41823 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.541244:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e600/0x8f4f7840b2e41823 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.541251:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e600/0x8f4f7840b2e41823 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.541257:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1bfa1e600 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:3.0:1789181498.541261:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e600/0x8f4f7840b2e41823 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.541269:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e600/0x8f4f7840b2e41823 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.541283:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9dc192187c00) 00010000:00010000:3.0:1789181498.541286:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181498.541290:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e600/0x8f4f7840b2e41823 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.541297:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e600/0x8f4f7840b2e41823 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181498.590860:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181498.590944:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488039808 00000100:00100000:3.0:1789181498.590967:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488039808 00000100:00100000:3.0:1789181498.591029:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 96 00000100:00100000:3.0:1789181498.591040:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b66f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+31:10505:x1876092488039808:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:3.0:1789181498.591101:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181498.591122:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e600/0x8f4f7840b2e41838 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f159 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.591265:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e4183f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.591493:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e4183f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.591503:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e4183f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.591712:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785600/0x8f4f7840b2e41846 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.591724:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785600/0x8f4f7840b2e41846 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.591732:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785600/0x8f4f7840b2e41846 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789181498.592495:0:5842:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:2.0:1789181498.592651:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785400/0x8f4f7840b2e4184d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.592662:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785400/0x8f4f7840b2e4184d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.592670:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785400/0x8f4f7840b2e4184d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.592702:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e4183f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.592709:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e4183f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.592726:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e4183f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.592733:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1bfa1ee00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:2.0:1789181498.592738:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e4183f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.592745:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e4183f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.592757:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9dc1995b7200) 00010000:00010000:2.0:1789181498.592760:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789181498.592765:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e4183f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.592771:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e4183f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789181498.593109:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001cc9eafc reply state 000000008a16dd26 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785600/0x8f4f7840b2e41846 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181498.593117:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789181498.593152:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e600/0x8f4f7840b2e41838 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f159 expref: 34 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.593167:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785400/0x8f4f7840b2e4184d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f159 expref: 33 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.593175:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9dc1995b7500) 00010000:00010000:2.0:1789181498.593177:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789181498.593188:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1ba785400, rc 0) 00000100:00100000:2.0:1789181498.593268:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b66f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+34:10505:x1876092488039808:12345-192.168.204.32@tcp:101:bash.0 Request processed in 2229us (2418us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1789181498.593277:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 96 00010000:00010000:3.0:1789181498.597753:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785600/0x8f4f7840b2e41846 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.597773:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785600/0x8f4f7840b2e41846 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.597780:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785600/0x8f4f7840b2e41846 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.597786:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1ba785600 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:3.0:1789181498.597791:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785600/0x8f4f7840b2e41846 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.597799:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785600/0x8f4f7840b2e41846 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.597815:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9dc1995b7700) 00010000:00010000:3.0:1789181498.597819:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181498.597824:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785600/0x8f4f7840b2e41846 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.597830:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785600/0x8f4f7840b2e41846 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181498.602997:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181498.603464:0:6894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488039936 00000100:00100000:1.0:1789181498.603476:0:6894:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488039936 00000100:00100000:1.0:1789181498.603551:0:6894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 35 00000100:00100000:1.0:1789181498.603561:0:6894:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1baba7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+5:2353:x1876092488039936:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:1.0:1789181498.603578:0:6894:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181498.603599:0:6894:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059f46ab8/0x8f4f7840b2e4185b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f160 expref: -99 pid: 6894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789181498.603916:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:1.0:1789181498.603948:0:6894:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789181498.603969:0:6894:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=390s v=(0 0) 00010000:00010000:1.0:1789181498.603984:0:6894:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789181498.603994:0:6894:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059f46ab8/0x8f4f7840b2e4185b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f160 expref: 6 pid: 6894 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181498.604016:0:6894:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000059f46ab8/0x8f4f7840b2e4185b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f160 expref: 6 pid: 6894 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181498.604031:0:6894:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc18151ae00, rc 0) 00000100:00100000:1.0:1789181498.604206:0:6894:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1baba7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+6:2353:x1876092488039936:12345-192.168.204.32@tcp:101:bash.0 Request processed in 646us (1219us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181498.604214:0:6894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 35 00000100:00100000:0.0:1789181498.610220:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181498.610767:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488040064 00000100:00100000:2.0:1789181498.610791:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488040064 00000100:00100000:2.0:1789181498.610845:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 36 00000100:00100000:2.0:1789181498.610854:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1a7308e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+6:10505:x1876092488040064:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:2.0:1789181498.610871:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181498.610889:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000046c3696d/0x8f4f7840b2e41862 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f167 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.610921:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000059f46ab8/0x8f4f7840b2e4185b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f160 expref: 7 pid: 6894 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.610930:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789181498.610934:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789181498.610939:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000046c3696d/0x8f4f7840b2e41862 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f167 expref: 7 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.610972:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000059f46ab8/0x8f4f7840b2e4185b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f160 expref: 7 pid: 6894 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.610986:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000059f46ab8/0x8f4f7840b2e4185b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f160 expref: 7 pid: 6894 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181498.611016:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1baba4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6691:1876092510079744:192.168.204.32@tcp:104: 00000100:00100000:2.0:1789181498.611132:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc18985d180 going to sleep for 11 seconds 00000100:00100000:2.0:1789181498.614996:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1baba4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6691:1876092510079744:192.168.204.32@tcp:104: 00010000:00010000:2.0:1789181498.615032:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000046c3696d/0x8f4f7840b2e41862 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f167 expref: 7 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.615137:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1ba785a00, rc 0) 00000100:00100000:2.0:1789181498.615197:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1a7308e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+7:10505:x1876092488040064:12345-192.168.204.32@tcp:101:bash.0 Request processed in 4344us (4988us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181498.615205:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 36 00000100:00100000:0.0:1789181498.615599:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181498.615658:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488040192 00000100:00100000:1.0:1789181498.615666:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488040192 00010000:00010000:1.0:1789181498.615701:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000059f46ab8/0x8f4f7840b2e4185b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f160 expref: 7 pid: 6894 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181498.615736:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 49 00000100:00100000:1.0:1789181498.615746:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19619e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+7:2354:x1876092488040192:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789181498.615761:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789181498.615785:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000059f46ab8/0x8f4f7840b2e4185b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f160 expref: 7 pid: 6894 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181498.615800:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000059f46ab8/0x8f4f7840b2e4185b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f160 expref: 7 pid: 6894 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181498.615823:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059f46ab8/0x8f4f7840b2e4185b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f160 expref: 7 pid: 6894 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181498.615863:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789181498.615868:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789181498.615877:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000046c3696d/0x8f4f7840b2e41862 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f167 expref: 6 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181498.615888:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000046c3696d/0x8f4f7840b2e41862 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f167 expref: 6 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181498.615926:0:5827:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000046c3696d/0x8f4f7840b2e41862 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f167 expref: 6 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181498.615941:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c065a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5827:1876092510079872:192.168.204.32@tcp:105: 00000100:00100000:1.0:1789181498.616011:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1c051a180 going to sleep for 11 seconds 00000100:00100000:2.0:1789181498.619883:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181498.620146:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c065a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5827:1876092510079872:192.168.204.32@tcp:105: 00010000:00010000:1.0:1789181498.620174:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789181498.620228:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19619e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+6:2354:x1876092488040192:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 4483us (4629us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181498.620238:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 49 00000100:00100000:0.0:1789181498.620739:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488040448 00000100:00100000:0.0:1789181498.620748:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488040448 00000100:00100000:0.0:1789181498.620789:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 25 00000100:00100000:0.0:1789181498.620798:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1baba4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+33:10505:x1876092488040448:12345-192.168.204.32@tcp:35:bash.0 00000100:00100000:0.0:1789181498.621787:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1baba4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+34:10505:x1876092488040448:12345-192.168.204.32@tcp:35:bash.0 Request processed in 985us (1910us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1789181498.622557:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 25 00000100:00100000:2.0:1789181498.777068:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181498.780927:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488040576 00000100:00100000:1.0:1789181498.780945:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488040576 00000100:00100000:1.0:1789181498.781016:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 97 00000100:00100000:1.0:1789181498.781027:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc188549180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+34:10521:x1876092488040576:12345-192.168.204.32@tcp:101:lfs.0 00010000:00010000:1.0:1789181498.781730:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181498.781754:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e41869 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f16e expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181498.781949:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151a800/0x8f4f7840b2e41870 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181498.781964:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151a800/0x8f4f7840b2e41870 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181498.781978:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151a800/0x8f4f7840b2e41870 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789181498.782011:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1789181498.782014:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789181498.782031:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151a800/0x8f4f7840b2e41870 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181498.782433:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e41869 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f16e expref: 36 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181498.782453:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151a800/0x8f4f7840b2e41870 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f16e expref: 35 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181498.782462:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9dc1995b7200) 00010000:00010000:1.0:1789181498.782465:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789181498.782468:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc18151a800, rc 0) 00000100:00100000:1.0:1789181498.782542:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc188549180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+35:10521:x1876092488040576:12345-192.168.204.32@tcp:101:lfs.0 Request processed in 1515us (5498us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181498.782549:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 97 00000100:00100000:3.0:1789181498.787503:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181498.787551:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488040832 00000100:00100000:2.0:1789181498.787562:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488040832 00000100:00100000:2.0:1789181498.787809:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 98 00000100:00100000:2.0:1789181498.787820:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b67aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+35:10521:x1876092488040832:12345-192.168.204.32@tcp:101:lfs.0 00010000:00010000:2.0:1789181498.787842:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181498.787866:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784000/0x8f4f7840b2e41877 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f175 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.787972:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e4187e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.787988:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e4187e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.788013:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e4187e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789181498.788023:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1789181498.788168:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784000/0x8f4f7840b2e41877 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f175 expref: 38 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.788188:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e4187e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f175 expref: 37 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.788197:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9dc1995b7500) 00010000:00010000:2.0:1789181498.788199:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789181498.788203:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1ba785c00, rc 0) 00000100:00100000:2.0:1789181498.788274:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b67aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+37:10521:x1876092488040832:12345-192.168.204.32@tcp:101:lfs.0 Request processed in 456us (780us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1789181498.788281:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 98 00000100:00100000:2.0:1789181498.795027:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181498.795085:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181498.795177:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488041216 00000100:00100000:1.0:1789181498.795186:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488041216 00000100:00100000:1.0:1789181498.795256:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 6 00000100:00100000:1.0:1789181498.795267:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+37:2351:x1876092488041216:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789181498.795283:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789181498.795307:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e4187e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f175 expref: 37 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181498.795350:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9dc1995b7500) 00010000:00010000:1.0:1789181498.795356:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789181498.795416:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+36:2351:x1876092488041216:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 151us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181498.795423:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 6 00000100:00100000:3.0:1789181498.795713:0:6887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488041088 00000100:00100000:3.0:1789181498.795719:0:6887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488041088 00000100:00100000:3.0:1789181498.795761:0:6887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 99 00000100:00100000:3.0:1789181498.795769:0:6887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc18854a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+36:10521:x1876092488041088:12345-192.168.204.32@tcp:101:lfs.0 00010000:00010000:3.0:1789181498.795792:0:6887:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181498.795809:0:6887:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e4188c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f17c expref: -99 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.795926:0:6887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e41893 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.795940:0:6887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e41893 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.795950:0:6887:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e41893 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789181498.795963:0:6887:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1789181498.796103:0:6887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e4188c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f17c expref: 39 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.796718:0:6887:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e41893 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f17c expref: 38 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.796726:0:6887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9dc1995b7500) 00010000:00010000:3.0:1789181498.796729:0:6887:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789181498.796732:0:6887:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1bfa1f000, rc 0) 00000100:00100000:3.0:1789181498.796834:0:6887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc18854a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+38:10521:x1876092488041088:12345-192.168.204.32@tcp:101:lfs.0 Request processed in 1065us (1823us total) trans 4294967379 rc 0/0 00000100:00100000:3.0:1789181498.796841:0:6887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 99 00000100:00100000:2.0:1789181498.803883:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181498.803964:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488041344 00000100:00100000:3.0:1789181498.803974:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488041344 00000100:00100000:3.0:1789181498.804075:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 37 00000100:00100000:3.0:1789181498.804088:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+6:2354:x1876092488041344:12345-192.168.204.32@tcp:1:lfs.0 00010000:00010000:3.0:1789181498.804144:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6277a25/0x8f4f7840b2e418a1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.804176:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000046c3696d/0x8f4f7840b2e41862 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f167 expref: 6 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.804186:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789181498.804191:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789181498.804196:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c6277a25/0x8f4f7840b2e418a1 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.804234:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000046c3696d/0x8f4f7840b2e41862 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f167 expref: 6 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.804250:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000046c3696d/0x8f4f7840b2e41862 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f167 expref: 6 pid: 6691 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181498.804266:0:6693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b67a8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6693:1876092510080000:192.168.204.32@tcp:104: 00000100:00100000:3.0:1789181498.804406:0:6693:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1aa4c70c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789181498.807522:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181498.807622:0:6693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b67a8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6693:1876092510080000:192.168.204.32@tcp:104: 00010000:00010000:3.0:1789181498.807651:0:6693:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c6277a25/0x8f4f7840b2e418a1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181498.807833:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488041472 00000100:00100000:0.0:1789181498.807861:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488041472 00002000:00100000:0.0:1789181498.807923:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9dc1c065a680 x1876092488041472/t0(0) o4->5971a429-48ca-4c07-88a3-fa58102a53bc@192.168.204.32@tcp:629/0 lens 504/0 e 0 to 0 dl 1789181509 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789181498.807933:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9dc1c065a680 with x1876092488041472 ext(0->8) 00010000:00010000:0.0:1789181498.807941:0:6697:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000046c3696d/0x8f4f7840b2e41862 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f167 expref: 7 pid: 6691 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181498.807956:0:6697:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000046c3696d/0x8f4f7840b2e41862 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f167 expref: 7 pid: 6691 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789181498.807964:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9dc1c065a680 00000100:00100000:0.0:1789181498.808052:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1 00000100:00100000:0.0:1789181498.808073:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c065a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+7:2353:x1876092488041472:12345-192.168.204.32@tcp:4:lfs.0 00000100:00100000:0.0:1789181498.808861:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c065a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+9:2353:x1876092488041472:12345-192.168.204.32@tcp:4:lfs.0 Request processed in 786us (1346us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1789181498.808871:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1 00002000:00100000:0.0:1789181498.808879:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9dc1c065a680 x1876092488041472/t4294967302(0) o4->5971a429-48ca-4c07-88a3-fa58102a53bc@192.168.204.32@tcp:629/0 lens 504/448 e 0 to 0 dl 1789181509 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789181498.808887:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9dc1c065a680 with x1876092488041472 ext(0->8) 00010000:00010000:0.0:1789181498.808894:0:6697:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000046c3696d/0x8f4f7840b2e41862 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f167 expref: 9 pid: 6691 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181498.808907:0:6697:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000046c3696d/0x8f4f7840b2e41862 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f167 expref: 9 pid: 6691 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789181498.808913:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9dc1c065a680 00000100:00100000:0.0:1789181498.812106:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181498.812320:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488041600 00000100:00100000:1.0:1789181498.812347:0:8456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488041600 00010000:00010000:1.0:1789181498.812390:0:8456:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000046c3696d/0x8f4f7840b2e41862 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f167 expref: 9 pid: 6691 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181498.812472:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 50 00000100:00100000:1.0:1789181498.812484:0:8456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1a730b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5971a429-48ca-4c07-88a3-fa58102a53bc+9:2354:x1876092488041600:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789181498.812500:0:8456:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1789181498.812521:0:8456:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1789181498.812525:0:8456:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1789181499 00002000:00010000:1.0:1789181498.812527:0:8456:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1789181499 00002000:00010000:1.0:1789181498.812529:0:8456:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1789181499 00010000:00010000:1.0:1789181498.812535:0:8456:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000046c3696d/0x8f4f7840b2e41862 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f167 expref: 9 pid: 6691 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181498.812568:0:8456:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000046c3696d/0x8f4f7840b2e41862 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f167 expref: 9 pid: 6691 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181498.812680:0:8456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000046c3696d/0x8f4f7840b2e41862 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f167 expref: 9 pid: 6691 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181498.812698:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789181498.812702:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789181498.812707:0:8456:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c6277a25/0x8f4f7840b2e418a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181498.812716:0:8456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c6277a25/0x8f4f7840b2e418a1 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181498.812772:0:8456:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789181498.812836:0:8456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1a730b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5971a429-48ca-4c07-88a3-fa58102a53bc+8:2354:x1876092488041600:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 354us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181498.812845:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 50 00010000:00010000:3.0:1789181498.812863:0:6693:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c6277a25/0x8f4f7840b2e418a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.812874:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c6277a25/0x8f4f7840b2e418a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.812903:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6277a25/0x8f4f7840b2e418a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.812912:0:6693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c6277a25/0x8f4f7840b2e418a1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.812920:0:6693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c6277a25/0x8f4f7840b2e418a1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.812927:0:6693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1bfa1e800 already unused, calling callback (ffffffffc152f9b0) 00010000:00010000:3.0:1789181498.812931:0:6693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6277a25/0x8f4f7840b2e418a1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.812940:0:6693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6277a25/0x8f4f7840b2e418a1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.812968:0:6693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c6277a25/0x8f4f7840b2e418a1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.812976:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c6277a25/0x8f4f7840b2e418a1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181498.813026:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+7:2354:x1876092488041344:12345-192.168.204.32@tcp:1:lfs.0 Request processed in 8941us (9151us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181498.813034:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 37 00000100:00100000:2.0:1789181498.815664:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181498.816002:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488041856 00000100:00100000:3.0:1789181498.816013:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488041856 00000100:00100000:3.0:1789181498.816082:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 26 00000100:00100000:3.0:1789181498.816533:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19928f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+38:10521:x1876092488041856:12345-192.168.204.32@tcp:35:lfs.0 00000004:00010000:2.0:1789181498.816736:0:5846:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e41893 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f17c expref: 38 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789181498.816972:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:2.0:1789181498.817020:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:2.0:1789181498.818731:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:2.0:1789181498.818814:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e418a8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.818849:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785400/0x8f4f7840b2e4184d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f159 expref: 42 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.818859:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e418a8 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.818904:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785400/0x8f4f7840b2e4184d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f159 expref: 42 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.818919:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785400/0x8f4f7840b2e4184d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f159 expref: 42 pid: 5842 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181498.818937:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfb2ea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5846:1876092510080128:192.168.204.32@tcp:104: 00000100:00100000:2.0:1789181498.819088:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1906603c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789181498.822103:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181498.822834:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfb2ea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5846:1876092510080128:192.168.204.32@tcp:104: 00010000:00010000:2.0:1789181498.822864:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e418a8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181498.824733:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488041984 00000100:00100000:1.0:1789181498.824747:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488041984 00010000:00010000:1.0:1789181498.824897:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785400/0x8f4f7840b2e4184d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f159 expref: 43 pid: 5842 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181498.824943:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 51 00000100:00100000:1.0:1789181498.825066:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb2f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+43:2353:x1876092488041984:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789181498.825098:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789181498.825106:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785400/0x8f4f7840b2e4184d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f159 expref: 43 pid: 5842 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181498.825120:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785400/0x8f4f7840b2e4184d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f159 expref: 43 pid: 5842 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181498.825141:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785400/0x8f4f7840b2e4184d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f159 expref: 43 pid: 5842 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181498.825157:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9dc1995b7500) 00010000:00010000:1.0:1789181498.825162:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e418a8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181498.825170:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e418a8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181498.825177:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e418a8 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181498.825212:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789181498.825614:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e418a8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.825623:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e418a8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789181498.825755:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000100:00100000:1.0:1789181498.825985:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb2f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+43:2353:x1876092488041984:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 931us (3887us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181498.825994:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 51 00000001:00080000:2.0:1789181498.826284:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:2.0:1789181498.826422:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfb2ea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1876092510080256:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789181498.826485:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181498.826515:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc187dfdcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789181498.826671:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510080256 00000100:00100000:1.0:1789181498.826678:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510080256 00000100:00100000:1.0:1789181498.826721:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789181498.826730:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c026df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5846:x1876092510080256:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789181498.826813:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c026df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5846:x1876092510080256:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 85us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181498.826826:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789181498.826984:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfb2ea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1876092510080256:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1789181498.827479:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:3.0:1789181498.827547:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b67a8000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1876092510080384:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789181498.827580:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181498.827927:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510080384 00000100:00100000:2.0:1789181498.827934:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510080384 00000100:00100000:3.0:1789181498.827936:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1aa4c7300 going to sleep for 11 seconds 00000100:00100000:2.0:1789181498.827962:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789181498.827970:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b67aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5846:x1876092510080384:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789181498.828481:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b67aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:5846:x1876092510080384:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 510us (898us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1789181498.828489:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789181498.828659:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b67a8000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1876092510080384:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1789181498.828718:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:3.0:1789181498.828756:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e418a8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.828766:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e418a8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.828787:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e418a8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.828870:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1ba785c00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:3.0:1789181498.828875:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e418a8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.828883:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e418a8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.828899:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9dc1995b7500) 00010000:00010000:3.0:1789181498.828902:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1789181498.828907:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e418a8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.828915:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e418a8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789181498.829177:0:5846:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1789181498.829416:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:3.0:1789181498.829427:0:5846:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 391086095337ns, next at 392086093101ns, rc = 0 00000001:00080000:3.0:1789181498.829433:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:3.0:1789181498.829464:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9dc1995b7500) 00010000:00010000:3.0:1789181498.829467:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789181498.829473:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e41893 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f17c expref: 46 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181498.829564:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19928f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+45:10521:x1876092488041856:12345-192.168.204.32@tcp:35:lfs.0 Request processed in 13473us (13909us total) trans 4294967388 rc 0/0 00000100:00100000:3.0:1789181498.829582:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 26 00000020:00080000:3.0:1789181498.829678:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1789181498.833609:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181498.833762:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488042112 00000100:00100000:3.0:1789181498.833771:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488042112 00000100:00100000:3.0:1789181498.833885:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 100 00000100:00100000:3.0:1789181498.833896:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1a7308a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+45:10521:x1876092488042112:12345-192.168.204.32@tcp:101:lfs.0 00010000:00010000:3.0:1789181498.833919:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181498.833941:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e800/0x8f4f7840b2e418af lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f183 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.834237:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e800/0x8f4f7840b2e418af lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f183 expref: 46 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.834264:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e800/0x8f4f7840b2e418af lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f183 expref: 46 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.834290:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9dc192187c00) 00010000:00010000:3.0:1789181498.834294:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789181498.834297:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1bfa1e800, rc 0) 00000100:00100000:3.0:1789181498.834546:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1a7308a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+46:10521:x1876092488042112:12345-192.168.204.32@tcp:101:lfs.0 Request processed in 651us (946us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181498.834553:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 100 00000100:00100000:2.0:1789181498.842051:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181498.842159:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488042368 00000100:00100000:0.0:1789181498.842170:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488042368 00000100:00100000:0.0:1789181498.842235:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 27 00000100:00100000:0.0:1789181498.842254:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c026dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+46:10521:x1876092488042368:12345-192.168.204.32@tcp:35:lfs.0 00000100:00100000:0.0:1789181498.842523:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c026dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+47:10521:x1876092488042368:12345-192.168.204.32@tcp:35:lfs.0 Request processed in 278us (481us total) trans 4294967389 rc 0/0 00000100:00100000:0.0:1789181498.842530:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 27 00000001:00080000:2.0:1789181498.931535:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:2.0:1789181498.931557:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00080000:2.0:1789181498.931562:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:1.0:1789181498.942147:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181498.942244:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488042496 00000100:00100000:2.0:1789181498.942254:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488042496 00000100:00100000:2.0:1789181498.942321:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 101 00000100:00100000:2.0:1789181498.942365:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c065b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+47:10531:x1876092488042496:12345-192.168.204.32@tcp:34:lfs.0 00010000:00010000:2.0:1789181498.942440:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e418b6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.942458:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e418b6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.942471:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e418b6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.942487:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785400/0x8f4f7840b2e418bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.942514:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785400/0x8f4f7840b2e418bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.942521:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785400/0x8f4f7840b2e418bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.942618:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785600/0x8f4f7840b2e418c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.942626:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785600/0x8f4f7840b2e418c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.942632:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785600/0x8f4f7840b2e418c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789181498.942676:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785600/0x8f4f7840b2e418c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.942689:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e418b6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.942696:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e418b6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.942703:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e418b6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.942709:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1ba785c00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:2.0:1789181498.942713:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e418b6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.942720:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e418b6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.942739:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9dc1995b7200) 00010000:00010000:2.0:1789181498.942742:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789181498.942747:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e418b6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.942754:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e418b6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.942770:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785400/0x8f4f7840b2e418bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.942776:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785400/0x8f4f7840b2e418bd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.942782:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785400/0x8f4f7840b2e418bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.942786:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1ba785400 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:2.0:1789181498.942789:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785400/0x8f4f7840b2e418bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.942794:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785400/0x8f4f7840b2e418bd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.942800:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9dc1995b7e00) 00010000:00010000:2.0:1789181498.942802:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789181498.942805:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785400/0x8f4f7840b2e418bd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.942809:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785400/0x8f4f7840b2e418bd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.942835:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785600/0x8f4f7840b2e418c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.942841:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785600/0x8f4f7840b2e418c4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.942846:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785600/0x8f4f7840b2e418c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.942851:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1ba785600 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:2.0:1789181498.942854:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785600/0x8f4f7840b2e418c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.942859:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785600/0x8f4f7840b2e418c4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.942866:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9dc192187c00) 00010000:00010000:2.0:1789181498.942868:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789181498.942871:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785600/0x8f4f7840b2e418c4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.942876:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785600/0x8f4f7840b2e418c4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181498.943545:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c065b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+47:10531:x1876092488042496:12345-192.168.204.32@tcp:34:lfs.0 Request processed in 617us (812us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181498.943560:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 101 00010000:00010000:2.0:1789181498.943941:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181498.987517:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181498.987628:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488042752 00000100:00100000:2.0:1789181498.987641:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488042752 00000100:00100000:2.0:1789181498.987719:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 102 00000100:00100000:2.0:1789181498.987732:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c0659880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+47:10534:x1876092488042752:12345-192.168.204.32@tcp:101:lfs.0 00010000:00010000:2.0:1789181498.987756:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181498.987777:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785600/0x8f4f7840b2e418cb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f18a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.987852:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785400/0x8f4f7840b2e418d2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.987869:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785400/0x8f4f7840b2e418d2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.987880:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785400/0x8f4f7840b2e418d2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.987895:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e418d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.987902:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e418d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.987909:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e418d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.988049:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785a00/0x8f4f7840b2e418e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.988068:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785a00/0x8f4f7840b2e418e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.988075:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785a00/0x8f4f7840b2e418e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789181498.988155:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1789181498.988253:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785400/0x8f4f7840b2e418d2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.988262:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785400/0x8f4f7840b2e418d2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.988268:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785400/0x8f4f7840b2e418d2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.988274:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1ba785400 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:2.0:1789181498.988278:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785400/0x8f4f7840b2e418d2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.988286:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785400/0x8f4f7840b2e418d2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.988298:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9dc1995b7200) 00010000:00010000:2.0:1789181498.988301:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789181498.988305:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785400/0x8f4f7840b2e418d2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.988311:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785400/0x8f4f7840b2e418d2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.988325:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e418d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.988492:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e418d9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.988509:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e418d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.988514:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1ba785c00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:2.0:1789181498.988517:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e418d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.988524:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e418d9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.988532:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9dc1995b7e00) 00010000:00010000:2.0:1789181498.988535:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789181498.988538:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e418d9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181498.988542:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e418d9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.988654:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785600/0x8f4f7840b2e418cb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f18a expref: 50 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.988669:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785a00/0x8f4f7840b2e418e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f18a expref: 49 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181498.988687:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9dc192187c00) 00010000:00010000:3.0:1789181498.988689:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789181498.988692:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1ba785a00, rc 0) 00000100:00100000:3.0:1789181498.988754:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c0659880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+49:10534:x1876092488042752:12345-192.168.204.32@tcp:101:lfs.0 Request processed in 1025us (1248us total) trans 4294967390 rc 0/0 00000100:00100000:3.0:1789181498.988762:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 102 00000100:00100000:1.0:1789181498.992762:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181498.992925:0:6887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488042880 00000100:00100000:0.0:1789181498.992935:0:6887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488042880 00000100:00100000:0.0:1789181498.992998:0:6887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 103 00000100:00100000:0.0:1789181498.993009:0:6887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c0658700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+49:10534:x1876092488042880:12345-192.168.204.32@tcp:54:lfs.0 00010000:00010000:0.0:1789181498.993102:0:6887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891800/0x8f4f7840b2e418ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181498.993304:0:6887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891800/0x8f4f7840b2e418ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181498.993316:0:6887:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891800/0x8f4f7840b2e418ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181498.993374:0:6887:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891800/0x8f4f7840b2e418ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181498.993382:0:6887:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891800/0x8f4f7840b2e418ee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181498.993389:0:6887:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891800/0x8f4f7840b2e418ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181498.993410:0:6887:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc189891800 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:0.0:1789181498.993415:0:6887:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891800/0x8f4f7840b2e418ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181498.993423:0:6887:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891800/0x8f4f7840b2e418ee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181498.993435:0:6887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9dc192187c00) 00010000:00010000:0.0:1789181498.993438:0:6887:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789181498.993444:0:6887:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891800/0x8f4f7840b2e418ee lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181498.993451:0:6887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891800/0x8f4f7840b2e418ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181498.993526:0:6887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c0658700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+49:10534:x1876092488042880:12345-192.168.204.32@tcp:54:lfs.0 Request processed in 518us (773us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181498.993534:0:6887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 103 00000100:00100000:0.0:1789181498.995376:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181498.995452:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488043136 00000100:00100000:2.0:1789181498.995461:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488043136 00000100:00100000:2.0:1789181498.995512:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 28 00000100:00100000:2.0:1789181498.995523:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1a730ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+49:10534:x1876092488043136:12345-192.168.204.32@tcp:35:lfs.0 00000100:00100000:2.0:1789181498.995726:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1a730ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+50:10534:x1876092488043136:12345-192.168.204.32@tcp:35:lfs.0 Request processed in 205us (358us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1789181498.995733:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 28 00000100:00100000:1.0:1789181499.065668:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181499.065761:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488043392 00000100:00100000:3.0:1789181499.065773:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488043392 00000100:00100000:3.0:1789181499.065941:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 104 00000100:00100000:3.0:1789181499.065956:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c065bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+50:10544:x1876092488043392:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:3.0:1789181499.065997:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181499.066002:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789181499.066037:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151a800/0x8f4f7840b2e41870 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f16e expref: 50 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.066069:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9dc1995b7200) 00010000:00010000:3.0:1789181499.066075:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789181499.066097:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e418f5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f191 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.066203:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e418fc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.066218:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785a00/0x8f4f7840b2e418e0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f18a expref: 50 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.066245:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e418fc lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.066278:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785a00/0x8f4f7840b2e418e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f18a expref: 50 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.066291:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785a00/0x8f4f7840b2e418e0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f18a expref: 50 pid: 5843 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181499.066304:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfb46d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1876092510080512:192.168.204.32@tcp:104: 00000100:00100000:3.0:1789181499.066437:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1aa4c76c0 going to sleep for 11 seconds 00000100:00080000:2.0:1789181499.066586:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789181499.070019:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181499.070135:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfb46d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1876092510080512:192.168.204.32@tcp:104: 00010000:00010000:3.0:1789181499.070163:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e418fc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181499.070234:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488043520 00000100:00100000:2.0:1789181499.070242:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488043520 00010000:00010000:2.0:1789181499.070291:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785a00/0x8f4f7840b2e418e0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f18a expref: 51 pid: 5843 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181499.070366:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 52 00000100:00100000:2.0:1789181499.070376:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1ba769880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+51:2353:x1876092488043520:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789181499.070391:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789181499.070398:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785a00/0x8f4f7840b2e418e0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f18a expref: 51 pid: 5843 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181499.070412:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785a00/0x8f4f7840b2e418e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f18a expref: 51 pid: 5843 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181499.070433:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785a00/0x8f4f7840b2e418e0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f18a expref: 51 pid: 5843 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181499.070450:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9dc192187c00) 00010000:00010000:2.0:1789181499.070455:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e418fc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181499.070464:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e418fc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181499.070474:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e418fc lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181499.070499:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789181499.070551:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1ba769880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+50:2353:x1876092488043520:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 177us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181499.070559:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 52 00010000:00010000:3.0:1789181499.070825:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e418fc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.070833:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e418fc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789181499.070851:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1789181499.070999:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e418f5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f191 expref: 51 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.071014:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e418fc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f191 expref: 50 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.071033:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9dc192187c00) 00010000:00010000:3.0:1789181499.071036:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789181499.071038:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1bfa1fa00, rc 0) 00000100:00100000:3.0:1789181499.071093:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c065bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+50:10544:x1876092488043392:12345-192.168.204.32@tcp:101:bash.0 Request processed in 5142us (5490us total) trans 4294967392 rc 0/0 00000100:00100000:3.0:1789181499.071099:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 104 00000100:00100000:1.0:1789181499.075859:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181499.075940:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488043776 00000100:00100000:2.0:1789181499.075961:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488043776 00000100:00100000:2.0:1789181499.076026:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 105 00000100:00100000:2.0:1789181499.076038:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1ba768a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+50:10544:x1876092488043776:12345-192.168.204.32@tcp:36:bash.0 00010000:00010000:2.0:1789181499.076376:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e4190a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181499.076395:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e4190a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181499.076406:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e4190a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789181499.076464:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:2.0:1789181499.076491:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bced4d69 reply state 00000000059f82be transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e4190a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181499.076501:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789181499.076576:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1ba768a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+53:10544:x1876092488043776:12345-192.168.204.32@tcp:36:bash.0 Request processed in 541us (730us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1789181499.076583:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 105 00000020:00080000:2.0:1789181499.076588:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789181499.078431:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e4190a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.078444:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e4190a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.078451:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e4190a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.078457:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1ba785c00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:3.0:1789181499.078461:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e4190a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.078468:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e4190a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.078482:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9dc192187c00) 00010000:00010000:3.0:1789181499.078486:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181499.078490:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e4190a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.078496:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e4190a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181499.080681:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181499.080764:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488043904 00000100:00100000:0.0:1789181499.080784:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488043904 00000100:00100000:0.0:1789181499.080839:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 106 00000100:00100000:0.0:1789181499.080850:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1ba76ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+52:10544:x1876092488043904:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:0.0:1789181499.080874:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181499.080894:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891800/0x8f4f7840b2e41911 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f198 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181499.081208:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890c00/0x8f4f7840b2e41918 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181499.081236:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e418fc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f191 expref: 53 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181499.081245:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890c00/0x8f4f7840b2e41918 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181499.081280:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e418fc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f191 expref: 53 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181499.081294:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e418fc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f191 expref: 53 pid: 5842 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181499.081308:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1a7309c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1876092510080640:192.168.204.32@tcp:104: 00000100:00100000:0.0:1789181499.081424:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1bfab46c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789181499.083834:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1a7309c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1876092510080640:192.168.204.32@tcp:104: 00010000:00010000:0.0:1789181499.083863:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890c00/0x8f4f7840b2e41918 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181499.086084:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181499.086378:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488044032 00000100:00100000:3.0:1789181499.086386:0:8456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488044032 00010000:00010000:3.0:1789181499.086427:0:8456:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e418fc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f191 expref: 54 pid: 5842 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181499.086456:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 53 00000100:00100000:3.0:1789181499.086465:0:8456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1ba769c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5971a429-48ca-4c07-88a3-fa58102a53bc+54:2354:x1876092488044032:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789181499.086478:0:8456:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789181499.086485:0:8456:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e418fc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f191 expref: 54 pid: 5842 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.086497:0:8456:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e418fc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f191 expref: 54 pid: 5842 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.086519:0:8456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e418fc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f191 expref: 54 pid: 5842 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.086535:0:8456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9dc192187c00) 00010000:00010000:3.0:1789181499.086540:0:8456:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890c00/0x8f4f7840b2e41918 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.086549:0:8456:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890c00/0x8f4f7840b2e41918 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.086556:0:8456:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890c00/0x8f4f7840b2e41918 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.086591:0:8456:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789181499.086662:0:8456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1ba769c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5971a429-48ca-4c07-88a3-fa58102a53bc+53:2354:x1876092488044032:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 197us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181499.086670:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 53 00010000:00010000:1.0:1789181499.087356:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890c00/0x8f4f7840b2e41918 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181499.087366:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890c00/0x8f4f7840b2e41918 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789181499.087408:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1789181499.087412:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789181499.087429:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890c00/0x8f4f7840b2e41918 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181499.087459:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891800/0x8f4f7840b2e41911 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f198 expref: 53 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181499.087473:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890c00/0x8f4f7840b2e41918 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f198 expref: 52 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181499.087481:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9dc192187c00) 00010000:00010000:1.0:1789181499.087484:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789181499.087495:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc189890c00, rc 0) 00000100:00100000:1.0:1789181499.087533:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1ba76ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+52:10544:x1876092488043904:12345-192.168.204.32@tcp:101:bash.0 Request processed in 6686us (6863us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181499.087540:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 106 00000100:00100000:1.0:1789181499.093637:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181499.093848:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488044288 00000100:00100000:2.0:1789181499.093859:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488044288 00000100:00100000:2.0:1789181499.094017:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 29 00000100:00100000:2.0:1789181499.094027:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6b51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+52:10544:x1876092488044288:12345-192.168.204.32@tcp:35:bash.0 00000100:00100000:2.0:1789181499.094968:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6b51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+53:10544:x1876092488044288:12345-192.168.204.32@tcp:35:bash.0 Request processed in 936us (1335us total) trans 4294967395 rc 0/0 00000100:00100000:2.0:1789181499.094978:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 29 00000100:00100000:3.0:1789181499.144743:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181499.145043:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488044416 00000100:00100000:2.0:1789181499.145068:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488044416 00000100:00100000:2.0:1789181499.145272:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 107 00000100:00100000:2.0:1789181499.145284:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+53:10550:x1876092488044416:12345-192.168.204.32@tcp:101:lfs.0 00010000:00010000:2.0:1789181499.145309:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181499.145370:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785400/0x8f4f7840b2e4191f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f19f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181499.145436:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784000/0x8f4f7840b2e41926 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181499.145449:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784000/0x8f4f7840b2e41926 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181499.145462:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784000/0x8f4f7840b2e41926 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789181499.145495:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1789181499.145509:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789181499.145527:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784000/0x8f4f7840b2e41926 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181499.145551:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785400/0x8f4f7840b2e4191f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f19f expref: 55 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181499.145569:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784000/0x8f4f7840b2e41926 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f19f expref: 54 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181499.145577:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9dc1995b7200) 00010000:00010000:2.0:1789181499.145580:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789181499.145598:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1ba784000, rc 0) 00000100:00100000:2.0:1789181499.145662:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+54:10550:x1876092488044416:12345-192.168.204.32@tcp:101:lfs.0 Request processed in 380us (928us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181499.145669:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 107 00000100:00100000:1.0:1789181499.147669:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181499.148382:0:6887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488044544 00000100:00100000:0.0:1789181499.148395:0:6887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488044544 00000100:00100000:0.0:1789181499.149461:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 108 00000100:00100000:0.0:1789181499.149479:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6b50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+54:10550:x1876092488044544:12345-192.168.204.32@tcp:101:lfs.0 00010000:00010000:0.0:1789181499.149502:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181499.149523:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891600/0x8f4f7840b2e4192d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f1a6 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181499.149666:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890400/0x8f4f7840b2e41934 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181499.149692:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890400/0x8f4f7840b2e41934 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181499.149705:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890400/0x8f4f7840b2e41934 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181499.149722:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890600/0x8f4f7840b2e4193b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181499.149730:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890600/0x8f4f7840b2e4193b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181499.149737:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890600/0x8f4f7840b2e4193b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181499.149898:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891c00/0x8f4f7840b2e41942 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181499.149907:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891c00/0x8f4f7840b2e41942 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181499.149914:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891c00/0x8f4f7840b2e41942 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789181499.149962:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1789181499.149967:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789181499.149985:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891c00/0x8f4f7840b2e41942 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181499.149998:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891c00/0x8f4f7840b2e41942 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181499.150016:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890400/0x8f4f7840b2e41934 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181499.150023:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890400/0x8f4f7840b2e41934 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181499.150041:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890400/0x8f4f7840b2e41934 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181499.150057:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc189890400 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:0.0:1789181499.150062:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890400/0x8f4f7840b2e41934 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181499.150070:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890400/0x8f4f7840b2e41934 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181499.150082:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9dc1995b7200) 00010000:00010000:0.0:1789181499.150085:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789181499.150090:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890400/0x8f4f7840b2e41934 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181499.150096:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890400/0x8f4f7840b2e41934 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181499.150110:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890600/0x8f4f7840b2e4193b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181499.150116:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890600/0x8f4f7840b2e4193b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181499.150122:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890600/0x8f4f7840b2e4193b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181499.150143:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc189890600 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:0.0:1789181499.150146:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890600/0x8f4f7840b2e4193b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181499.150153:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890600/0x8f4f7840b2e4193b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181499.150161:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9dc18553a900) 00010000:00010000:0.0:1789181499.150164:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789181499.150167:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890600/0x8f4f7840b2e4193b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181499.150174:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890600/0x8f4f7840b2e4193b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181499.150205:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891600/0x8f4f7840b2e4192d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f1a6 expref: 56 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181499.150530:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891c00/0x8f4f7840b2e41942 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f1a6 expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181499.150545:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9dc192187c00) 00010000:00010000:0.0:1789181499.150547:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789181499.150550:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc189891c00, rc 0) 00000100:00100000:0.0:1789181499.150630:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6b50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+55:10550:x1876092488044544:12345-192.168.204.32@tcp:101:lfs.0 Request processed in 1157us (2969us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181499.150637:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 108 00000100:00100000:1.0:1789181499.155364:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181499.155493:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181499.155684:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488044928 00000100:00100000:0.0:1789181499.155707:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488044928 00000100:00100000:3.0:1789181499.155728:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488044800 00000100:00100000:3.0:1789181499.155736:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488044800 00000100:00100000:3.0:1789181499.155785:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 109 00000100:00100000:3.0:1789181499.155798:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6b51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+56:10550:x1876092488044800:12345-192.168.204.32@tcp:101:lfs.0 00010000:00010000:3.0:1789181499.155817:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181499.155838:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e41949 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f1ad expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181499.155839:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 7 00000100:00100000:0.0:1789181499.155852:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfcf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+57:2352:x1876092488044928:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789181499.155866:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789181499.155888:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891c00/0x8f4f7840b2e41942 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f1a6 expref: 57 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181499.155904:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9dc192187c00) 00010000:00010000:0.0:1789181499.155909:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789181499.155956:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e41950 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.155971:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890c00/0x8f4f7840b2e41918 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f198 expref: 56 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.155981:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e41950 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181499.156002:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfcf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+56:2352:x1876092488044928:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 151us (507us total) trans 0 rc 0/0 00010000:00010000:3.0:1789181499.156016:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890c00/0x8f4f7840b2e41918 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f198 expref: 56 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181499.156016:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 7 00010000:00010000:3.0:1789181499.156035:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890c00/0x8f4f7840b2e41918 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f198 expref: 55 pid: 5843 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181499.156060:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1baba4000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1876092510080768:192.168.204.32@tcp:104: 00000100:00100000:3.0:1789181499.156750:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1aa4c76c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789181499.160901:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1baba4000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1876092510080768:192.168.204.32@tcp:104: 00010000:00010000:3.0:1789181499.160933:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e41950 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181499.162237:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181499.162311:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488045056 00000100:00100000:0.0:1789181499.162319:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488045056 00010000:00010000:0.0:1789181499.162389:0:6707:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890c00/0x8f4f7840b2e41918 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f198 expref: 56 pid: 5843 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181499.162430:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 54 00000100:00100000:0.0:1789181499.162440:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19619f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+56:2353:x1876092488045056:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789181499.162455:0:6707:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789181499.162461:0:6707:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890c00/0x8f4f7840b2e41918 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f198 expref: 56 pid: 5843 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181499.162475:0:6707:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890c00/0x8f4f7840b2e41918 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f198 expref: 56 pid: 5843 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181499.162498:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890c00/0x8f4f7840b2e41918 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f198 expref: 56 pid: 5843 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181499.162528:0:6707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9dc192187c00) 00010000:00010000:0.0:1789181499.162534:0:6707:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e41950 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181499.162544:0:6707:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e41950 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181499.162552:0:6707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e41950 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181499.162589:0:6707:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789181499.162646:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19619f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+55:2353:x1876092488045056:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 207us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181499.162653:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 54 00010000:00010000:2.0:1789181499.162815:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e41950 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181499.162825:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e41950 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789181499.162860:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1789181499.163022:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e41949 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f1ad expref: 56 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181499.163040:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e41950 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f1ad expref: 55 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181499.163059:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9dc192187c00) 00010000:00010000:2.0:1789181499.163062:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789181499.163064:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1bfa1f000, rc 0) 00000100:00100000:2.0:1789181499.163103:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6b51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+55:10550:x1876092488044800:12345-192.168.204.32@tcp:101:lfs.0 Request processed in 7299us (7775us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1789181499.163112:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 109 00000100:00100000:1.0:1789181499.166363:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181499.166455:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488045312 00000100:00100000:0.0:1789181499.166465:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488045312 00000100:00100000:0.0:1789181499.166527:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 8 00000100:00100000:0.0:1789181499.166537:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfcf5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+55:10550:x1876092488045312:12345-192.168.204.32@tcp:103:lfs.0 00010000:00010000:0.0:1789181499.166553:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789181499.166576:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e800/0x8f4f7840b2e418af lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f183 expref: 55 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181499.166595:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9dc192187c00) 00010000:00010000:0.0:1789181499.166600:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789181499.166665:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfcf5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+54:10550:x1876092488045312:12345-192.168.204.32@tcp:103:lfs.0 Request processed in 128us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181499.166672:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 8 00000100:00100000:1.0:1789181499.169316:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181499.169770:0:6887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488045440 00000100:00100000:3.0:1789181499.169781:0:6887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488045440 00000100:00100000:3.0:1789181499.169840:0:6887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 110 00000100:00100000:3.0:1789181499.169849:0:6887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfcf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+54:10550:x1876092488045440:12345-192.168.204.32@tcp:58:lfs.0 00010000:00010000:3.0:1789181499.169944:0:6887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e4195e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.169961:0:6887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e4195e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.169973:0:6887:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e4195e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789181499.170193:0:6887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:3.0:1789181499.170282:0:6887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfcf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+54:10550:x1876092488045440:12345-192.168.204.32@tcp:58:lfs.0 Request processed in 434us (974us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181499.170289:0:6887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 110 00000100:00100000:1.0:1789181499.172869:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181499.173491:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488045568 00000100:00100000:2.0:1789181499.173502:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488045568 00000100:00100000:2.0:1789181499.173598:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 111 00000100:00100000:2.0:1789181499.173617:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfcf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+54:10550:x1876092488045568:12345-192.168.204.32@tcp:101:lfs.0 00010000:00010000:2.0:1789181499.173636:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181499.173675:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785400/0x8f4f7840b2e41965 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f1b4 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181499.173735:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e4195e lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181499.173747:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785400/0x8f4f7840b2e41965 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f1b4 expref: 55 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181499.173765:0:5844:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e4195e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181499.173779:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785400/0x8f4f7840b2e41965 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f1b4 expref: 55 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181499.173792:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9dc192187c00) 00010000:00010000:2.0:1789181499.173795:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789181499.173799:0:5844:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785400/0x8f4f7840b2e41965 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f1b4 expref: 55 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181499.173808:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1ba785400, rc 0) 00000100:00100000:2.0:1789181499.173871:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfcf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+55:10550:x1876092488045568:12345-192.168.204.32@tcp:101:lfs.0 Request processed in 264us (1010us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181499.173878:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 111 00000040:00080000:1.0:1789181499.390807:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789181499.390822:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789181499.390884:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1789181499.390892:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789181499.391253:0:11694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc19c36c700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11694:1876092510080896:192.168.204.32@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789181499.391398:0:11694:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1c051a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789181499.398198:0:11694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc19c36c700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11694:1876092510080896:192.168.204.32@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789181499.398732:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181499.398815:0:6887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488045696 00000100:00100000:3.0:1789181499.398823:0:6887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488045696 00000100:00100000:3.0:1789181499.398899:0:6887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 112 00000100:00100000:3.0:1789181499.398910:0:6887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c36fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+55:10551:x1876092488045696:12345-192.168.204.32@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789181499.398945:0:6887:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789181499.399071:0:6887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c36fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+55:10551:x1876092488045696:12345-192.168.204.32@tcp:53:lhsmtool_posix.0 Request processed in 161us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181499.399103:0:6887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 112 00000100:00100000:1.0:1789181499.407190:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181499.407794:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488045824 00000100:00100000:3.0:1789181499.407807:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488045824 00000100:00100000:3.0:1789181499.407887:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 113 00000100:00100000:3.0:1789181499.407900:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c36f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+55:10551:x1876092488045824:12345-192.168.204.32@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789181499.407972:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e4196c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.407991:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e4196c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.408002:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e4196c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.408014:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f800/0x8f4f7840b2e41973 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.408021:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f800/0x8f4f7840b2e41973 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.408027:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f800/0x8f4f7840b2e41973 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.408059:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e4197a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.408069:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e4197a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.408076:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e4197a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789181499.408131:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1789181499.408136:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789181499.408149:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e4197a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.408160:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e4196c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.408168:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e4196c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.408174:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e4196c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.408180:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1bfa1fc00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:3.0:1789181499.408185:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e4196c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.408193:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e4196c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.408205:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9dc192187200) 00010000:00010000:3.0:1789181499.408208:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181499.408213:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e4196c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.408219:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e4196c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.408235:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f800/0x8f4f7840b2e41973 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.408250:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f800/0x8f4f7840b2e41973 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.408256:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f800/0x8f4f7840b2e41973 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.408261:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1bfa1f800 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:3.0:1789181499.408265:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f800/0x8f4f7840b2e41973 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.408271:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f800/0x8f4f7840b2e41973 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.408278:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff9dc192187e00) 00010000:00010000:3.0:1789181499.408281:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181499.408283:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f800/0x8f4f7840b2e41973 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.408290:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f800/0x8f4f7840b2e41973 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.408305:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e4197a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.408311:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e4197a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.408316:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e4197a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.408320:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1bfa1f400 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:3.0:1789181499.408366:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e4197a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.408374:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e4197a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.408383:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9dc192187c00) 00010000:00010000:3.0:1789181499.408386:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181499.408389:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e4197a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.408394:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e4197a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181499.408472:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c36f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+55:10551:x1876092488045824:12345-192.168.204.32@tcp:34:lhsmtool_posix.0 Request processed in 575us (1291us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181499.408481:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 113 00000100:00100000:2.0:1789181499.411985:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181499.412275:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488046080 00000100:00100000:0.0:1789181499.412287:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488046080 00000100:00100000:0.0:1789181499.412370:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 114 00000100:00100000:0.0:1789181499.412383:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c026bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+55:10551:x1876092488046080:12345-192.168.204.32@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789181499.412408:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181499.412435:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890c00/0x8f4f7840b2e41981 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f1bb expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181499.412564:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891c00/0x8f4f7840b2e41988 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181499.412582:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891c00/0x8f4f7840b2e41988 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181499.412595:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891c00/0x8f4f7840b2e41988 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789181499.412608:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1789181499.412715:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891c00/0x8f4f7840b2e41988 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181499.412723:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891c00/0x8f4f7840b2e41988 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181499.412730:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891c00/0x8f4f7840b2e41988 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181499.412735:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc189891c00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:0.0:1789181499.412739:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891c00/0x8f4f7840b2e41988 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181499.412760:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891c00/0x8f4f7840b2e41988 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181499.412788:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9dc192187c00) 00010000:00010000:0.0:1789181499.412791:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789181499.412796:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891c00/0x8f4f7840b2e41988 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181499.412803:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891c00/0x8f4f7840b2e41988 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181499.412846:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890c00/0x8f4f7840b2e41981 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f1bb expref: 57 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181499.412857:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9dc192187200) 00010000:00010000:0.0:1789181499.412859:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789181499.412863:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890c00/0x8f4f7840b2e41981 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f1bb expref: 57 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181499.412872:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc189890c00, rc 0) 00000100:00100000:0.0:1789181499.412937:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c026bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+56:10551:x1876092488046080:12345-192.168.204.32@tcp:101:lhsmtool_posix.0 Request processed in 556us (964us total) trans 4294967397 rc 301/301 00000100:00100000:0.0:1789181499.412954:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 114 00000100:00100000:3.0:1789181499.417559:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181499.417983:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488046208 00000100:00100000:2.0:1789181499.417995:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488046208 00000100:00100000:2.0:1789181499.418064:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 115 00000100:00100000:2.0:1789181499.418075:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1baba4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+56:10551:x1876092488046208:12345-192.168.204.32@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789181499.418158:0:5844:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789181499.418264:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1baba4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+56:10551:x1876092488046208:12345-192.168.204.32@tcp:53:lhsmtool_posix.0 Request processed in 190us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181499.418272:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 115 00000100:00100000:1.0:1789181499.430625:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181499.431184:0:6887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488046464 00000100:00100000:3.0:1789181499.431195:0:6887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488046464 00000100:00100000:3.0:1789181499.431261:0:6887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 116 00000100:00100000:3.0:1789181499.431273:0:6887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c36c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+56:10551:x1876092488046464:12345-192.168.204.32@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789181499.431293:0:6887:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181499.431297:0:6887:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789181499.431324:0:6887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784000/0x8f4f7840b2e41926 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f19f expref: 56 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.431386:0:6887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9dc1995b7200) 00010000:00010000:3.0:1789181499.431391:0:6887:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789181499.431420:0:6887:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e41996 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f1c2 expref: -99 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789181499.432230:0:6887:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:3.0:1789181499.433029:0:6887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f800/0x8f4f7840b2e4199d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.433060:0:6887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f800/0x8f4f7840b2e4199d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.433072:0:6887:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f800/0x8f4f7840b2e4199d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.433134:0:6887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e41996 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f1c2 expref: 58 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.433153:0:6887:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f800/0x8f4f7840b2e4199d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f1c2 expref: 57 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.433162:0:6887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9dc192187e00) 00010000:00010000:3.0:1789181499.433165:0:6887:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789181499.433173:0:6887:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1bfa1f800, rc 0) 00000100:00100000:3.0:1789181499.433249:0:6887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c36c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+57:10551:x1876092488046464:12345-192.168.204.32@tcp:101:lhsmtool_posix.0 Request processed in 1979us (2646us total) trans 4294967398 rc 0/0 00000100:00100000:3.0:1789181499.433257:0:6887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 116 00000100:00100000:1.0:1789181499.441441:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181499.441536:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488046720 00000100:00100000:2.0:1789181499.441546:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488046720 00000100:00100000:2.0:1789181499.441605:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 117 00000100:00100000:2.0:1789181499.441616:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1825a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+57:10551:x1876092488046720:12345-192.168.204.32@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789181499.441674:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789181499.441700:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f800/0x8f4f7840b2e4199d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f1c2 expref: 57 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181499.441721:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9dc192187e00) 00010000:00010000:2.0:1789181499.441730:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789181499.441750:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785a00/0x8f4f7840b2e419ab lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181499.441763:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785a00/0x8f4f7840b2e419ab lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181499.441772:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785a00/0x8f4f7840b2e419ab lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181499.441784:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e419b2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x221a943d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181499.441790:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e419b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x221a943d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181499.441812:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e419b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x221a943d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181499.441882:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785a00/0x8f4f7840b2e419ab lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181499.441889:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785a00/0x8f4f7840b2e419ab lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181499.441896:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785a00/0x8f4f7840b2e419ab lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181499.441902:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1ba785a00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:2.0:1789181499.441907:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785a00/0x8f4f7840b2e419ab lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181499.441914:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785a00/0x8f4f7840b2e419ab lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181499.441932:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9dc1995b7200) 00010000:00010000:2.0:1789181499.441934:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789181499.441938:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785a00/0x8f4f7840b2e419ab lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181499.442138:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785a00/0x8f4f7840b2e419ab lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181499.442153:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e419b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x221a943d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181499.442159:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e419b2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x221a943d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181499.442172:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e419b2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x221a943d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181499.442177:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1ba785c00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:2.0:1789181499.442180:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e419b2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x221a943d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181499.442187:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e419b2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x221a943d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181499.442195:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x221a943d (ffff9dc1995b7e00) 00010000:00010000:2.0:1789181499.442198:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789181499.442201:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e419b2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x221a943d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181499.442207:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e419b2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x221a943d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181499.442287:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1825a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+56:10551:x1876092488046720:12345-192.168.204.32@tcp:36:lhsmtool_posix.0 Request processed in 672us (856us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789181499.442295:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 117 00000100:00100000:0.0:1789181499.453697:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181499.453797:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488046848 00000100:00100000:1.0:1789181499.453808:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488046848 00000100:00100000:1.0:1789181499.453970:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 118 00000100:00100000:1.0:1789181499.453983:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1a730b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+56:10551:x1876092488046848:12345-192.168.204.32@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789181499.454007:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181499.454055:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151aa00/0x8f4f7840b2e419b9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f1c9 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181499.454294:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151a600/0x8f4f7840b2e419c0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181499.454308:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151a600/0x8f4f7840b2e419c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181499.454319:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151a600/0x8f4f7840b2e419c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181499.454468:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151aa00/0x8f4f7840b2e419b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f1c9 expref: 58 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181499.454486:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151a600/0x8f4f7840b2e419c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f1c9 expref: 57 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181499.454495:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9dc18a6c2700) 00010000:00010000:1.0:1789181499.454498:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789181499.454501:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc18151a600, rc 0) 00000100:00100000:1.0:1789181499.455024:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1a730b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+57:10551:x1876092488046848:12345-192.168.204.32@tcp:101:lhsmtool_posix.0 Request processed in 1041us (1335us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181499.455033:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 118 00000100:00100000:1.0:1789181499.462009:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181499.462172:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488047104 00000100:00100000:2.0:1789181499.462183:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488047104 00000100:00100000:2.0:1789181499.462257:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 119 00000100:00100000:2.0:1789181499.462269:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1825a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+57:10551:x1876092488047104:12345-192.168.204.32@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789181499.462395:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785a00/0x8f4f7840b2e419c7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181499.462414:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785a00/0x8f4f7840b2e419c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181499.462439:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785a00/0x8f4f7840b2e419c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789181499.462696:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00010000:2.0:1789181499.462787:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007c21bc41 reply state 00000000ee4b94b4 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785a00/0x8f4f7840b2e419c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181499.462797:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789181499.462880:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1825a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+59:10551:x1876092488047104:12345-192.168.204.32@tcp:36:lhsmtool_posix.0 Request processed in 613us (881us total) trans 4294967399 rc 0/0 00000100:00100000:2.0:1789181499.462887:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 119 00000100:00100000:1.0:1789181499.468517:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181499.468761:0:6887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488047232 00000100:00100000:0.0:1789181499.468773:0:6887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488047232 00000100:00100000:0.0:1789181499.468835:0:6887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 120 00000100:00100000:0.0:1789181499.468846:0:6887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1825a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+59:10551:x1876092488047232:12345-192.168.204.32@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789181499.468984:0:6887:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181499.469007:0:6887:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891600/0x8f4f7840b2e419ce lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f1d0 expref: -99 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181499.469292:0:6887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891600/0x8f4f7840b2e419ce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f1d0 expref: 60 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181499.469311:0:6887:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891600/0x8f4f7840b2e419ce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f1d0 expref: 60 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181499.469375:0:6887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9dc18a6c2700) 00010000:00010000:0.0:1789181499.469379:0:6887:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789181499.469383:0:6887:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc189891600, rc 0) 00000100:00100000:0.0:1789181499.469439:0:6887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1825a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+60:10551:x1876092488047232:12345-192.168.204.32@tcp:101:lhsmtool_posix.0 Request processed in 595us (933us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181499.469446:0:6887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 120 00010000:00010000:3.0:1789181499.469714:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785a00/0x8f4f7840b2e419c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.469724:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785a00/0x8f4f7840b2e419c7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.469742:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785a00/0x8f4f7840b2e419c7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.469749:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1ba785a00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:3.0:1789181499.469753:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785a00/0x8f4f7840b2e419c7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.469761:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785a00/0x8f4f7840b2e419c7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.469773:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9dc18a6c2700) 00010000:00010000:3.0:1789181499.469776:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789181499.469780:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785a00/0x8f4f7840b2e419c7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.469787:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785a00/0x8f4f7840b2e419c7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181499.473746:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181499.473822:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488047360 00000100:00100000:3.0:1789181499.473832:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488047360 00000100:00100000:3.0:1789181499.473905:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 38 00000100:00100000:3.0:1789181499.473916:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1a7309c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+6:2354:x1876092488047360:12345-192.168.204.32@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1789181499.474290:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1a7309c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+7:2354:x1876092488047360:12345-192.168.204.32@tcp:2:lhsmtool_posix.0 Request processed in 375us (553us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1789181499.474299:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 38 00000100:00100000:2.0:1789181499.478438:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181499.478469:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181499.478501:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181499.478540:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181499.478573:0:6894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488047872 00000100:00100000:2.0:1789181499.478583:0:6894:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488047872 00000100:00100000:3.0:1789181499.478698:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488047744 00000100:00100000:3.0:1789181499.478703:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488047744 00000100:00100000:3.0:1789181499.478744:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 288 00000100:00100000:3.0:1789181499.478754:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c273050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:975a0591-a8f7-4a74-9f93-a5aa77f2315c+13:2353:x1876092488047744:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:3.0:1789181499.478839:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c273050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:975a0591-a8f7-4a74-9f93-a5aa77f2315c+13:2353:x1876092488047744:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 86us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181499.478848:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 288 00000100:00100000:0.0:1789181499.478957:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488047616 00000100:00100000:0.0:1789181499.478962:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488047616 00000100:00100000:0.0:1789181499.479001:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 30 00000100:00100000:0.0:1789181499.479009:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+59:10551:x1876092488047616:12345-192.168.204.32@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789181499.479218:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488048000 00000100:00100000:1.0:1789181499.479223:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488048000 00000100:00100000:0.0:1789181499.479236:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+60:10551:x1876092488047616:12345-192.168.204.32@tcp:35:lhsmtool_posix.0 Request processed in 228us (809us total) trans 4294967400 rc 0/0 00000100:00100000:0.0:1789181499.479243:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 30 00000100:00100000:1.0:1789181499.479268:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 137 00000100:00100000:1.0:1789181499.479275:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7badad21-a177-49b1-a2af-7b11e28c02ce+5:2353:x1876092488048000:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:1.0:1789181499.479310:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7badad21-a177-49b1-a2af-7b11e28c02ce+5:2353:x1876092488048000:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 36us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181499.479316:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 137 00000100:00080000:3.0:1789181499.479459:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789181499.479711:0:6894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 78 00000100:00100000:2.0:1789181499.479720:0:6894:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+5:2353:x1876092488047872:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:2.0:1789181499.479754:0:6894:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+5:2353:x1876092488047872:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 36us (1214us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181499.479760:0:6894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 78 00000100:00100000:1.0:1789181499.481496:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181499.481585:0:6887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488048256 00000100:00100000:0.0:1789181499.481593:0:6887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488048256 00000100:00100000:0.0:1789181499.481665:0:6887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 121 00000100:00100000:0.0:1789181499.481674:0:6887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6af3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+60:10551:x1876092488048256:12345-192.168.204.32@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789181499.481754:0:6887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6af3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+60:10551:x1876092488048256:12345-192.168.204.32@tcp:57:lhsmtool_posix.0 Request processed in 82us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181499.481762:0:6887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 121 00000100:00100000:0.0:1789181499.485556:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181499.485713:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488048384 00000100:00100000:1.0:1789181499.485724:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488048384 00000100:00100000:1.0:1789181499.485878:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 122 00000100:00100000:1.0:1789181499.485901:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1a730bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+60:10551:x1876092488048384:12345-192.168.204.32@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789181499.485922:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181499.485943:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b600/0x8f4f7840b2e419d5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f1d7 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181499.486023:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e419dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181499.486037:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e419dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181499.486531:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e419dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789181499.486588:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789181499.486677:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e419dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181499.486710:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b600/0x8f4f7840b2e419d5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f1d7 expref: 62 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181499.486729:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e419dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f1d7 expref: 61 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181499.486755:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9dc18a6c2700) 00010000:00010000:1.0:1789181499.486759:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789181499.486763:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc18151ae00, rc 0) 00000100:00100000:1.0:1789181499.486831:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1a730bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+61:10551:x1876092488048384:12345-192.168.204.32@tcp:101:lhsmtool_posix.0 Request processed in 943us (1288us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181499.486839:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 122 00000100:00100000:1.0:1789181499.490981:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181499.491138:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488048512 00000100:00100000:3.0:1789181499.491149:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488048512 00000100:00100000:3.0:1789181499.491246:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 39 00000100:00100000:3.0:1789181499.491257:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6af0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+7:2352:x1876092488048512:12345-192.168.204.32@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789181499.491277:0:6692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181499.491299:0:6692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d47cdaa/0x8f4f7840b2e419e3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f1de expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789181499.491361:0:6692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa4be3c, blocks: 0x1 00010000:00010000:3.0:1789181499.491385:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=391s v=(0 0) 00010000:00010000:3.0:1789181499.491390:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789181499.491402:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d47cdaa/0x8f4f7840b2e419e3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f1de expref: 8 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.491423:0:6692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005d47cdaa/0x8f4f7840b2e419e3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f1de expref: 8 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.491438:0:6692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1bfa1f400, rc 0) 00000100:00100000:3.0:1789181499.491503:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6af0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+8:2352:x1876092488048512:12345-192.168.204.32@tcp:101:lhsmtool_posix.0 Request processed in 247us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181499.491510:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 39 00000100:00100000:2.0:1789181499.494321:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181499.494590:0:6887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488048768 00000100:00100000:0.0:1789181499.494600:0:6887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488048768 00000100:00100000:0.0:1789181499.494675:0:6887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 123 00000100:00100000:0.0:1789181499.494686:0:6887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+61:10551:x1876092488048768:12345-192.168.204.32@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789181499.494802:0:6887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+61:10551:x1876092488048768:12345-192.168.204.32@tcp:57:lhsmtool_posix.0 Request processed in 117us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181499.494809:0:6887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 123 00000100:00100000:0.0:1789181499.497666:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181499.497807:0:6894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488048896 00000100:00100000:2.0:1789181499.497818:0:6894:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488048896 00000100:00100000:2.0:1789181499.497876:0:6894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 40 00000100:00100000:2.0:1789181499.497887:0:6894:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1a7308380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+8:10551:x1876092488048896:12345-192.168.204.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789181499.497918:0:6894:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181499.497939:0:6894:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d58e8e1e/0x8f4f7840b2e419ea lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f1e5 expref: -99 pid: 6894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181499.497974:0:6894:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005d47cdaa/0x8f4f7840b2e419e3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f1de expref: 9 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181499.497983:0:6894:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789181499.497988:0:6894:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789181499.497994:0:6894:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d58e8e1e/0x8f4f7840b2e419ea lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f1e5 expref: 9 pid: 6894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181499.498029:0:6894:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005d47cdaa/0x8f4f7840b2e419e3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f1de expref: 9 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181499.498054:0:6894:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005d47cdaa/0x8f4f7840b2e419e3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f1de expref: 9 pid: 6692 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181499.498069:0:6894:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfb7ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:6894:1876092510081024:192.168.204.32@tcp:104: 00000100:00100000:2.0:1789181499.498216:0:6894:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc18985d9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789181499.501838:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181499.501908:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488049024 00000100:00100000:0.0:1789181499.501917:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488049024 00010000:00010000:0.0:1789181499.501955:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005d47cdaa/0x8f4f7840b2e419e3 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f1de expref: 10 pid: 6692 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181499.501997:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 55 00000100:00100000:0.0:1789181499.502007:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb7c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+10:2354:x1876092488049024:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789181499.502021:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789181499.502058:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005d47cdaa/0x8f4f7840b2e419e3 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f1de expref: 10 pid: 6692 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181499.502098:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005d47cdaa/0x8f4f7840b2e419e3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f1de expref: 10 pid: 6692 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181499.502132:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789181499.502137:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789181499.502145:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d58e8e1e/0x8f4f7840b2e419ea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f1e5 expref: 10 pid: 6894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181499.502154:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d58e8e1e/0x8f4f7840b2e419ea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f1e5 expref: 10 pid: 6894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181499.502192:0:5827:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d58e8e1e/0x8f4f7840b2e419ea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f1e5 expref: 10 pid: 6894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181499.502206:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1a7309f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5827:1876092510081152:192.168.204.32@tcp:105: 00000100:00100000:0.0:1789181499.502283:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1bfab4840 going to sleep for 11 seconds 00010000:00010000:1.0:1789181499.503003:0:6894:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d47cdaa/0x8f4f7840b2e419e3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f1de expref: 10 pid: 6692 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181499.503113:0:6894:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfb7ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:6894:1876092510081024:192.168.204.32@tcp:104: 00010000:00010000:1.0:1789181499.503143:0:6894:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d58e8e1e/0x8f4f7840b2e419ea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f1e5 expref: 9 pid: 6894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181499.503155:0:6894:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1ba785c00, rc 0) 00000100:00100000:1.0:1789181499.503205:0:6894:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1a7308380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+9:10551:x1876092488048896:12345-192.168.204.32@tcp:101:lhsmtool_posix.0 Request processed in 5320us (5550us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181499.503214:0:6894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 40 00000100:00100000:0.0:1789181499.506768:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1a7309f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5827:1876092510081152:192.168.204.32@tcp:105: 00010000:00010000:0.0:1789181499.506800:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789181499.506861:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb7c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+8:2354:x1876092488049024:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 4855us (5030us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181499.506871:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 55 00000100:00100000:0.0:1789181499.511308:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181499.511580:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488049152 00000100:00100000:1.0:1789181499.511591:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488049152 00002000:00100000:1.0:1789181499.511642:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9dc1a7309f80 x1876092488049152/t0(0) o4->5971a429-48ca-4c07-88a3-fa58102a53bc@192.168.204.32@tcp:630/0 lens 504/0 e 0 to 0 dl 1789181510 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789181499.511653:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9dc1a7309f80 with x1876092488049152 ext(0->12) 00002000:00010000:1.0:1789181499.511659:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9dc1a7309f80 00000100:00100000:1.0:1789181499.511698:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 3 00000100:00100000:1.0:1789181499.511708:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1a7309f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+8:2352:x1876092488049152:12345-192.168.204.32@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789181499.512394:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1a7309f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+10:2352:x1876092488049152:12345-192.168.204.32@tcp:4:lhsmtool_posix.0 Request processed in 683us (1091us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1789181499.512403:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 3 00002000:00100000:1.0:1789181499.512411:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9dc1a7309f80 x1876092488049152/t4294967309(0) o4->5971a429-48ca-4c07-88a3-fa58102a53bc@192.168.204.32@tcp:630/0 lens 504/448 e 0 to 0 dl 1789181510 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789181499.512420:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9dc1a7309f80 with x1876092488049152 ext(0->12) 00002000:00010000:1.0:1789181499.512424:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9dc1a7309f80 00000100:00100000:3.0:1789181499.516227:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181499.516541:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488049280 00000100:00100000:0.0:1789181499.516552:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488049280 00000100:00100000:0.0:1789181499.516884:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 124 00000100:00100000:0.0:1789181499.516896:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+61:10551:x1876092488049280:12345-192.168.204.32@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1789181499.639223:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+61:10551:x1876092488049280:12345-192.168.204.32@tcp:44:lhsmtool_posix.0 Request processed in 122318us (122996us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181499.639236:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 124 00000001:00080000:2.0:1789181499.639276:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000020:00080000:2.0:1789181499.639388:0:5865:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9dc189899840 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:2.0:1789181499.639393:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9dc1991de800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9dc189899000 00000020:00080000:2.0:1789181499.639397:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9dc1991de300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9dc1884c2c00 00000004:00080000:2.0:1789181499.639426:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:2.0:1789181499.639440:0:5865:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9dc1aa4c79c0 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:2.0:1789181499.639443:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9dc1bfa04600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9dc1aa4c70c0 00000020:00080000:2.0:1789181499.639446:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9dc1bfa04100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9dc1bfba4c00 00000004:00080000:2.0:1789181499.639451:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:2.0:1789181499.639468:0:5865:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:2.0:1789181499.639483:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:2.0:1789181499.639672:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1789181499.640064:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfb7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876092510081280:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789181499.640120:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181499.640252:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfa63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510081408:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789181499.640285:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181499.640359:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510081280 00000100:00100000:2.0:1789181499.640366:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510081280 00000100:00100000:2.0:1789181499.640409:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510081408 00000100:00100000:2.0:1789181499.640413:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510081408 00000100:00100000:2.0:1789181499.640449:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789181499.640457:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1a7309880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1876092510081280:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789181499.640482:0:6691:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:2.0:1789181499.640515:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aa4be3b, atime: 0x6aa4be3b, ctime: 0x6aa4be3b, blocks: 0xb 00010000:00010000:2.0:1789181499.640524:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b83ed00/0x8f4f7840b2e419f1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181499.640542:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=391s v=(0 0) 00010000:00010000:2.0:1789181499.640547:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789181499.640555:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b83ed00/0x8f4f7840b2e419f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181499.640590:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b83ed00/0x8f4f7840b2e419f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181499.640601:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b83ed00/0x8f4f7840b2e419f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181499.640609:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b83ed00/0x8f4f7840b2e419f1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181499.640627:0:6691:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789181499.641033:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789181499.641057:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b66de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510081408:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1789181499.641072:0:6692:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:3.0:1789181499.641136:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6277a25/0x8f4f7840b2e419f8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.641154:0:6692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cf2d2bc7/0x8f4f7840b2e417b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f144 expref: 9 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.641163:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789181499.641166:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789181499.641173:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c6277a25/0x8f4f7840b2e419f8 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.641203:0:6692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cf2d2bc7/0x8f4f7840b2e417b3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f144 expref: 9 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.641217:0:6692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cf2d2bc7/0x8f4f7840b2e417b3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f144 expref: 9 pid: 6693 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789181499.641223:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789181499.641229:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfb2f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6692:1876092510081536:192.168.204.32@tcp:104: 00000100:00100000:3.0:1789181499.641295:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1aa4c7180 going to sleep for 11 seconds 00000100:00100000:2.0:1789181499.641703:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1a7309880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3304:x1876092510081280:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1245us (1581us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1789181499.641711:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789181499.641782:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:0.0:1789181499.641789:0:3304:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967303 00000004:00080000:0.0:1789181499.641876:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9dc1ba76aa00, transno 4294967301 00000004:00080000:0.0:1789181499.642058:0:3304:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967303 00000100:00100000:0.0:1789181499.642078:0:3304:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9dc1bfb7ed80 x1876092510081280/t4294967304(4294967304) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789181515 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1789181499.642091:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9dc1bfb7ed80/2, rc 0, transno 4294967304 00010000:00010000:3.0:1789181499.642115:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789181499.642122:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b83ed00/0x8f4f7840b2e419f1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.642143:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1ba784200 already unused, calling callback (ffffffffc152f9b0) 00010000:00010000:3.0:1789181499.642147:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b83ed00/0x8f4f7840b2e419f1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.642157:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b83ed00/0x8f4f7840b2e419f1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.642176:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b83ed00/0x8f4f7840b2e419f1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.642183:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b83ed00/0x8f4f7840b2e419f1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.642202:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181499.642204:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181499.642205:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181499.642396:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfb7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876092510081280:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789181499.646704:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181499.646788:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181499.646814:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488049408 00000100:00100000:1.0:1789181499.646883:0:8456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488049408 00010000:00010000:1.0:1789181499.646977:0:8456:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cf2d2bc7/0x8f4f7840b2e417b3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f144 expref: 10 pid: 6693 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181499.647155:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 56 00000100:00100000:1.0:1789181499.647166:0:8456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5971a429-48ca-4c07-88a3-fa58102a53bc+10:2353:x1876092488049408:12345-192.168.204.32@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1789181499.647167:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488049536 00000100:00100000:0.0:1789181499.647172:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488049536 00010000:00010000:1.0:1789181499.647181:0:8456:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789181499.647186:0:8456:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cf2d2bc7/0x8f4f7840b2e417b3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f144 expref: 11 pid: 6693 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181499.647199:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 43 00010000:00010000:1.0:1789181499.647201:0:8456:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cf2d2bc7/0x8f4f7840b2e417b3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f144 expref: 11 pid: 6693 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181499.647206:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1988c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+11:2353:x1876092488049536:12345-192.168.204.32@tcp:16:lhsmtool_posix.0 00010000:00010000:1.0:1789181499.647238:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789181499.647242:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789181499.647248:0:8456:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c6277a25/0x8f4f7840b2e419f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181499.647258:0:8456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c6277a25/0x8f4f7840b2e419f8 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181499.647279:0:8456:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789181499.647357:0:8456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5971a429-48ca-4c07-88a3-fa58102a53bc+11:2353:x1876092488049408:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 193us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181499.647364:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 56 00010000:00010000:2.0:1789181499.647808:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cf2d2bc7/0x8f4f7840b2e417b3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f144 expref: 10 pid: 6693 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181499.647825:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfb2f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6692:1876092510081536:192.168.204.32@tcp:104: 00010000:00010000:2.0:1789181499.647848:0:6692:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c6277a25/0x8f4f7840b2e419f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181499.647859:0:6692:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c6277a25/0x8f4f7840b2e419f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181499.647866:0:6692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c6277a25/0x8f4f7840b2e419f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181499.647884:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6277a25/0x8f4f7840b2e419f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181499.647891:0:6692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c6277a25/0x8f4f7840b2e419f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181499.647907:0:6692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789181499.649170:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789181499.649181:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c6277a25/0x8f4f7840b2e419f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181499.649192:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1bfa1e800 already unused, calling callback (ffffffffc152f9b0) 00010000:00010000:0.0:1789181499.649197:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6277a25/0x8f4f7840b2e419f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181499.649208:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6277a25/0x8f4f7840b2e419f8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181499.649236:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c6277a25/0x8f4f7840b2e419f8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181499.649245:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c6277a25/0x8f4f7840b2e419f8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181499.649267:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181499.649269:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181499.649271:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789181499.652008:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b66de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1876092510081408:12345-0@lo:6:osp-syn-1-0.0 Request processed in 10958us (11712us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1789181499.652022:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789181499.657281:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:1.0:1789181499.657293:0:3305:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967305 00000100:00100000:1.0:1789181499.657318:0:3305:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9dc1bfa63100 x1876092510081408/t4294967310(4294967310) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789181515 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1789181499.657362:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9dc1bfa63100/2, rc 0, transno 4294967310 00000100:00100000:1.0:1789181499.657375:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfa63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510081408:0@lo:6:osp-syn-1-0.0 00000001:00080000:2.0:1789181499.687981:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:2.0:1789181499.688282:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000100:00100000:3.0:1789181499.688696:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1988c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+6:2353:x1876092488049536:12345-192.168.204.32@tcp:16:lhsmtool_posix.0 Request processed in 41484us (41902us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181499.688708:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 43 00000100:00100000:3.0:1789181499.696399:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181499.696549:0:6887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488049792 00000100:00100000:0.0:1789181499.696560:0:6887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488049792 00000100:00100000:0.0:1789181499.696625:0:6887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 125 00000100:00100000:0.0:1789181499.696636:0:6887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1988c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+15:10551:x1876092488049792:12345-192.168.204.32@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789181499.696688:0:6887:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789181499.696714:0:6887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e419dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f1d7 expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181499.696734:0:6887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9dc18a6c2700) 00010000:00010000:0.0:1789181499.696739:0:6887:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789181499.696769:0:6887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891200/0x8f4f7840b2e419ff lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181499.696783:0:6887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891200/0x8f4f7840b2e419ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181499.696793:0:6887:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891200/0x8f4f7840b2e419ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789181499.697315:0:6887:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000d779d1d reply state 0000000019c26942 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891200/0x8f4f7840b2e419ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181499.697326:0:6887:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789181499.698493:0:6887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1988c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+16:10551:x1876092488049792:12345-192.168.204.32@tcp:36:lhsmtool_posix.0 Request processed in 1853us (2098us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1789181499.698504:0:6887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 125 00000100:00100000:0.0:1789181499.701765:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181499.702269:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488049920 00000100:00100000:2.0:1789181499.702279:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488049920 00000100:00100000:2.0:1789181499.702357:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 44 00000100:00100000:2.0:1789181499.702368:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1a7309180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+6:2353:x1876092488049920:12345-192.168.204.32@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789181499.702612:0:6691:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1789181499.702616:0:6691:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1789181500 00002000:00010000:2.0:1789181499.702619:0:6691:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1789181499 00002000:00010000:2.0:1789181499.702621:0:6691:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1789181500 -> 1789181500 00002000:00010000:2.0:1789181499.702623:0:6691:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1789181499.702677:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1a7309180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+7:2353:x1876092488049920:12345-192.168.204.32@tcp:2:lhsmtool_posix.0 Request processed in 311us (921us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1789181499.702684:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 44 00010000:00010000:3.0:1789181499.704774:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891200/0x8f4f7840b2e419ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.704790:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891200/0x8f4f7840b2e419ff lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.704809:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891200/0x8f4f7840b2e419ff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.704815:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc189891200 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:3.0:1789181499.704820:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891200/0x8f4f7840b2e419ff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.704827:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891200/0x8f4f7840b2e419ff lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.704842:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9dc18a6c2700) 00010000:00010000:3.0:1789181499.704845:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181499.704850:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891200/0x8f4f7840b2e419ff lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.704857:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891200/0x8f4f7840b2e419ff lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181499.708011:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181499.708556:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488050176 00000100:00100000:3.0:1789181499.708567:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488050176 00000100:00100000:3.0:1789181499.708638:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 126 00000100:00100000:3.0:1789181499.708649:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b66ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+15:10551:x1876092488050176:12345-192.168.204.32@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789181499.708713:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e41a06 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.708730:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151a600/0x8f4f7840b2e419c0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f1c9 expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.708755:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e41a06 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.708790:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151a600/0x8f4f7840b2e419c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f1c9 expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.708815:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151a600/0x8f4f7840b2e419c0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f1c9 expref: 15 pid: 5843 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181499.708830:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1988c0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1876092510081664:192.168.204.32@tcp:104: 00000100:00100000:3.0:1789181499.708912:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1aa4c7540 going to sleep for 11 seconds 00000100:00100000:3.0:1789181499.713079:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181499.713306:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488050304 00000100:00100000:0.0:1789181499.713316:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488050304 00010000:00010000:0.0:1789181499.713381:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151a600/0x8f4f7840b2e419c0 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f1c9 expref: 16 pid: 5843 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181499.713418:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 57 00000100:00100000:0.0:1789181499.713443:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1988c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+16:2353:x1876092488050304:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789181499.713459:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789181499.713466:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151a600/0x8f4f7840b2e419c0 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f1c9 expref: 16 pid: 5843 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181499.713479:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151a600/0x8f4f7840b2e419c0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f1c9 expref: 16 pid: 5843 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181499.713500:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9dc18a6c2700) 00010000:00010000:0.0:1789181499.713506:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e41a06 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181499.713515:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e41a06 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181499.713524:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e41a06 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181499.713563:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789181499.713611:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1988c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+16:2353:x1876092488050304:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 185us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181499.713618:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 57 00010000:00010000:1.0:1789181499.715646:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151a600/0x8f4f7840b2e419c0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f1c9 expref: 15 pid: 5843 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181499.715668:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1988c0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1876092510081664:192.168.204.32@tcp:104: 00010000:00010000:1.0:1789181499.715691:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e41a06 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181499.715712:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e41a06 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181499.715719:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e41a06 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181499.715748:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e41a06 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181499.715755:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e41a06 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181499.715761:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e41a06 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181499.715767:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1bfa1fc00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:1.0:1789181499.715772:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e41a06 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181499.715779:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e41a06 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181499.716012:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9dc18a6c2700) 00010000:00010000:1.0:1789181499.716016:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1789181499.716022:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e41a06 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181499.716028:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e41a06 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181499.716612:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b66ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+14:10551:x1876092488050176:12345-192.168.204.32@tcp:55:lhsmtool_posix.0 Request processed in 7962us (8609us total) trans 0 rc -22/-22 00000100:00100000:1.0:1789181499.716632:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 126 00000100:00100000:2.0:1789181499.721031:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181499.721274:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488050432 00000100:00100000:0.0:1789181499.721445:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488050432 00000100:00100000:0.0:1789181499.721522:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 45 00000100:00100000:0.0:1789181499.721533:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfa60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+7:2353:x1876092488050432:12345-192.168.204.32@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789181499.721572:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000004b969b5e/0x8f4f7840b2e41a0d lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181499.721592:0:6692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d58e8e1e/0x8f4f7840b2e419ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f1e5 expref: 7 pid: 6894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181499.721611:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789181499.721616:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789181499.721621:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b969b5e/0x8f4f7840b2e41a0d lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181499.721658:0:6692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d58e8e1e/0x8f4f7840b2e419ea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f1e5 expref: 7 pid: 6894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181499.721672:0:6692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d58e8e1e/0x8f4f7840b2e419ea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f1e5 expref: 7 pid: 6894 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181499.721687:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1a7308700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6692:1876092510081792:192.168.204.32@tcp:104: 00000100:00100000:0.0:1789181499.721822:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1bfab4840 going to sleep for 11 seconds 00000100:00100000:1.0:1789181499.725777:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181499.725905:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488050560 00000100:00100000:2.0:1789181499.725914:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488050560 00010000:00010000:2.0:1789181499.726013:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d58e8e1e/0x8f4f7840b2e419ea lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f1e5 expref: 8 pid: 6894 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181499.726094:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 58 00000100:00100000:2.0:1789181499.726104:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b66df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+8:2353:x1876092488050560:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789181499.726126:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789181499.726148:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d58e8e1e/0x8f4f7840b2e419ea lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f1e5 expref: 8 pid: 6894 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181499.726162:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d58e8e1e/0x8f4f7840b2e419ea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f1e5 expref: 8 pid: 6894 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181499.726186:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789181499.726190:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789181499.726195:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004b969b5e/0x8f4f7840b2e41a0d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181499.726205:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b969b5e/0x8f4f7840b2e41a0d lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181499.726224:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789181499.726279:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b66df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+8:2353:x1876092488050560:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 176us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181499.726286:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 58 00010000:00010000:0.0:1789181499.728462:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d58e8e1e/0x8f4f7840b2e419ea lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f1e5 expref: 7 pid: 6894 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181499.728484:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1a7308700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6692:1876092510081792:192.168.204.32@tcp:104: 00010000:00010000:0.0:1789181499.728508:0:6692:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004b969b5e/0x8f4f7840b2e41a0d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181499.728519:0:6692:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004b969b5e/0x8f4f7840b2e41a0d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181499.728525:0:6692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b969b5e/0x8f4f7840b2e41a0d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181499.728557:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000004b969b5e/0x8f4f7840b2e41a0d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181499.728565:0:6692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004b969b5e/0x8f4f7840b2e41a0d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181499.728573:0:6692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004b969b5e/0x8f4f7840b2e41a0d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181499.728581:0:6692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc189891000 already unused, calling callback (ffffffffc152f9b0) 00010000:00010000:0.0:1789181499.728585:0:6692:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004b969b5e/0x8f4f7840b2e41a0d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181499.728625:0:6692:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004b969b5e/0x8f4f7840b2e41a0d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181499.728644:0:6692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004b969b5e/0x8f4f7840b2e41a0d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181499.728652:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b969b5e/0x8f4f7840b2e41a0d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181499.728734:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfa60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+6:2353:x1876092488050432:12345-192.168.204.32@tcp:1:lhsmtool_posix.0 Request processed in 7202us (7711us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181499.728743:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 45 00000100:00100000:1.0:1789181499.734113:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181499.734236:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488050816 00000100:00100000:3.0:1789181499.734246:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488050816 00000100:00100000:3.0:1789181499.734309:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 127 00000100:00100000:3.0:1789181499.734320:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b66dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+14:10551:x1876092488050816:12345-192.168.204.32@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789181499.734440:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e41a14 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.734463:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e41a14 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.734479:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e41a14 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.734817:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e600/0x8f4f7840b2e41a1b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.734840:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891600/0x8f4f7840b2e419ce lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f1d0 expref: 15 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.734848:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e600/0x8f4f7840b2e41a1b lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.734880:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891600/0x8f4f7840b2e419ce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f1d0 expref: 15 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.734895:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891600/0x8f4f7840b2e419ce lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f1d0 expref: 15 pid: 6887 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181499.734910:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1988c3100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1876092510081920:192.168.204.32@tcp:104: 00000100:00100000:3.0:1789181499.734985:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1aa4c7600 going to sleep for 11 seconds 00000100:00100000:0.0:1789181499.738797:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181499.738880:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488050944 00000100:00100000:1.0:1789181499.738889:0:8456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488050944 00010000:00010000:1.0:1789181499.738927:0:8456:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891600/0x8f4f7840b2e419ce lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f1d0 expref: 16 pid: 6887 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181499.738977:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 59 00000100:00100000:1.0:1789181499.738986:0:8456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1a7308700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5971a429-48ca-4c07-88a3-fa58102a53bc+16:2354:x1876092488050944:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789181499.739001:0:8456:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789181499.739008:0:8456:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891600/0x8f4f7840b2e419ce lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f1d0 expref: 16 pid: 6887 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181499.739019:0:8456:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891600/0x8f4f7840b2e419ce lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f1d0 expref: 16 pid: 6887 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181499.739051:0:8456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9dc18a6c2700) 00010000:00010000:1.0:1789181499.739057:0:8456:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e600/0x8f4f7840b2e41a1b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181499.739066:0:8456:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e600/0x8f4f7840b2e41a1b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181499.739073:0:8456:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e600/0x8f4f7840b2e41a1b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181499.739100:0:8456:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789181499.739185:0:8456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1a7308700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5971a429-48ca-4c07-88a3-fa58102a53bc+16:2354:x1876092488050944:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 199us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181499.739192:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 59 00010000:00010000:3.0:1789181499.739914:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891600/0x8f4f7840b2e419ce lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f1d0 expref: 15 pid: 6887 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181499.739933:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1988c3100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1876092510081920:192.168.204.32@tcp:104: 00010000:00010000:3.0:1789181499.739966:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e600/0x8f4f7840b2e41a1b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.739976:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e600/0x8f4f7840b2e41a1b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.739981:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e600/0x8f4f7840b2e41a1b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789181499.740437:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:3.0:1789181499.740596:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:3.0:1789181499.740642:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:3.0:1789181499.740726:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1988c3100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5843:1876092510082048:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789181499.740779:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181499.740816:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1aa4c70c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789181499.741067:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510082048 00000100:00100000:2.0:1789181499.741083:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510082048 00000100:00100000:2.0:1789181499.741140:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789181499.741150:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1988c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5843:x1876092510082048:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789181499.741232:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1988c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5843:x1876092510082048:12345-0@lo:1000:mdt00_001.0 Request processed in 84us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181499.741239:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789181499.741772:0:5843:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:3.0:1789181499.741778:0:5843:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9dc1bfa63100, transno 4294967310 00000100:00100000:3.0:1789181499.741797:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1988c3100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5843:1876092510082048:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1789181499.742718:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:3.0:1789181499.742797:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1988c3100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5843:1876092510082176:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789181499.742855:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181499.742890:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1aa4c7600 going to sleep for 11 seconds 00000100:00100000:2.0:1789181499.743566:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510082176 00000100:00100000:2.0:1789181499.743575:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510082176 00000100:00100000:2.0:1789181499.743631:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789181499.743641:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1988c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5843:x1876092510082176:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789181499.743846:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1988c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5843:x1876092510082176:12345-0@lo:1000:mdt00_001.0 Request processed in 206us (990us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1789181499.743854:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789181499.743993:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1988c3100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5843:1876092510082176:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1789181499.744029:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e600/0x8f4f7840b2e41a1b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.744056:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e600/0x8f4f7840b2e41a1b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.744064:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e600/0x8f4f7840b2e41a1b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.744070:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1bfa1e600 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:3.0:1789181499.744084:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e600/0x8f4f7840b2e41a1b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.744093:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e600/0x8f4f7840b2e41a1b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.744118:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9dc18a6c2700) 00010000:00010000:3.0:1789181499.744132:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789181499.744138:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e600/0x8f4f7840b2e41a1b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.744145:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e600/0x8f4f7840b2e41a1b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.744176:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e4195e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.744183:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e4195e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.744189:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e4195e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.744194:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1bfa1fe00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:3.0:1789181499.744197:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e4195e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.744203:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e4195e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.744211:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9dc192187c00) 00010000:00010000:3.0:1789181499.744213:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789181499.744220:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785400/0x8f4f7840b2e41965 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f1b4 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.744232:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785400/0x8f4f7840b2e41965 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f1b4 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.744242:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785400/0x8f4f7840b2e41965 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f1b4 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.744277:0:5843:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785400/0x8f4f7840b2e41965 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f1b4 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181499.744290:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1988c3800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1876092510082304:192.168.204.32@tcp:105: 00000100:00100000:3.0:1789181499.744396:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1aa4c7600 going to sleep for 11 seconds 00000100:00100000:3.0:1789181499.748561:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1988c3800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1876092510082304:192.168.204.32@tcp:105: 00010000:00010000:3.0:1789181499.748590:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e4195e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.748600:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e4195e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.748635:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e41a22 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.748647:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e41a22 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.748660:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e41a22 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.748670:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e41a22 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.748676:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e41a22 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.748683:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e41a22 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.748704:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1bfa1ee00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:3.0:1789181499.748709:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e41a22 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.748716:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e41a22 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.748727:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9dc192187c00) 00010000:00010000:3.0:1789181499.748729:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181499.748733:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e41a22 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.748738:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e41a22 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.748748:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e41a14 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.748754:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e41a14 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.748760:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e41a14 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.748765:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1bfa1fa00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:3.0:1789181499.748768:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e41a14 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.748773:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e41a14 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.748787:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9dc192187c00) 00010000:00010000:3.0:1789181499.748789:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789181499.748792:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e41a14 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.748798:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e41a14 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181499.749007:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b66dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+18:10551:x1876092488050816:12345-192.168.204.32@tcp:57:lhsmtool_posix.0 Request processed in 14688us (14902us total) trans 4294967406 rc 0/0 00000100:00100000:3.0:1789181499.749016:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 127 00000020:00080000:3.0:1789181499.749021:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789181499.749291:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789181499.749296:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789181499.749951:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1789181499.749959:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789181499.752508:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181499.752870:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488051072 00000100:00100000:0.0:1789181499.752881:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488051072 00000100:00100000:0.0:1789181499.752946:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 31 00000100:00100000:0.0:1789181499.752958:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b66de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+18:10550:x1876092488051072:12345-192.168.204.32@tcp:49:lfs.0 00000100:00100000:0.0:1789181499.753114:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b66de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+18:10550:x1876092488051072:12345-192.168.204.32@tcp:49:lfs.0 Request processed in 159us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181499.753122:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 31 00000100:00100000:2.0:1789181499.755990:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181499.756251:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488051328 00000100:00100000:0.0:1789181499.756277:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488051328 00000100:00100000:0.0:1789181499.756358:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 32 00000100:00100000:0.0:1789181499.756369:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19928f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+18:10551:x1876092488051328:12345-192.168.204.32@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789181499.757028:0:5845:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789181499.757400:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:0.0:1789181499.757445:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891000/0x8f4f7840b2e41a29 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181499.757461:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891000/0x8f4f7840b2e41a29 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181499.757473:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891000/0x8f4f7840b2e41a29 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181499.757481:0:5845:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891000/0x8f4f7840b2e41a29 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181499.757488:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891000/0x8f4f7840b2e41a29 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181499.757493:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891000/0x8f4f7840b2e41a29 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181499.757521:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789181499.757874:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19928f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+20:10551:x1876092488051328:12345-192.168.204.32@tcp:35:lhsmtool_posix.0 Request processed in 1503us (1888us total) trans 4294967408 rc 0/0 00000100:00100000:0.0:1789181499.757883:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 32 00000020:00080000:0.0:1789181499.757888:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789181499.757995:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789181499.758003:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891000/0x8f4f7840b2e41a29 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181499.758010:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc189891000 already unused, calling callback (ffffffffc152f9b0) 00010000:00010000:2.0:1789181499.758015:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891000/0x8f4f7840b2e41a29 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181499.758023:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891000/0x8f4f7840b2e41a29 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181499.758051:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9dc18553ad00) 00010000:00010000:2.0:1789181499.758054:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789181499.758059:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891000/0x8f4f7840b2e41a29 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181499.758080:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891000/0x8f4f7840b2e41a29 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181499.758098:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181499.758100:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181499.758101:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181499.761052:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181499.761183:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488051584 00000100:00100000:2.0:1789181499.761191:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488051584 00000100:00100000:2.0:1789181499.761249:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 128 00000100:00100000:2.0:1789181499.761261:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b66de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+20:10550:x1876092488051584:12345-192.168.204.32@tcp:58:lfs.0 00000040:00080000:2.0:1789181499.761537:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:2.0:1789181499.761624:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b66de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+20:10550:x1876092488051584:12345-192.168.204.32@tcp:58:lfs.0 Request processed in 365us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181499.761632:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 128 00000100:00100000:0.0:1789181499.793933:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181499.797718:0:6887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488051712 00000100:00100000:2.0:1789181499.797734:0:6887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488051712 00000100:00100000:3.0:1789181499.799427:0:6887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 129 00000100:00100000:3.0:1789181499.799442:0:6887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1a730ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+20:10553:x1876092488051712:12345-192.168.204.32@tcp:101:lfs.0 00010000:00010000:3.0:1789181499.799467:0:6887:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181499.799487:0:6887:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e41a30 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f1ec expref: -99 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.799560:0:6887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e41a37 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.799575:0:6887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e41a37 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.799586:0:6887:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e41a37 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.799601:0:6887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e41a3e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.799624:0:6887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e41a3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.799631:0:6887:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e41a3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.799845:0:6887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e600/0x8f4f7840b2e41a45 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.799856:0:6887:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e41950 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f1ad expref: 21 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.799865:0:6887:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e600/0x8f4f7840b2e41a45 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.799896:0:6887:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e41950 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f1ad expref: 21 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.799909:0:6887:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e41950 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f1ad expref: 21 pid: 5842 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181499.799921:0:6887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1988c3800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6887:1876092510082432:192.168.204.32@tcp:104: 00000100:00100000:3.0:1789181499.800015:0:6887:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1aa4c7a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789181499.804976:0:6887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1988c3800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6887:1876092510082432:192.168.204.32@tcp:104: 00010000:00010000:0.0:1789181499.805026:0:6887:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e600/0x8f4f7840b2e41a45 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181499.805848:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181499.806576:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488051968 00000100:00100000:3.0:1789181499.806586:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488051968 00000100:00100000:3.0:1789181499.806701:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 33 00000100:00100000:3.0:1789181499.806712:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1a7309500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+22:5592:x1876092488051968:12345-192.168.204.32@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789181499.806953:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1a7309500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+23:5592:x1876092488051968:12345-192.168.204.32@tcp:35:ldlm_bl.0 Request processed in 243us (1109us total) trans 4294967409 rc 0/0 00000100:00100000:3.0:1789181499.806973:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 33 00000100:00100000:2.0:1789181499.810326:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181499.810517:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488052096 00000100:00100000:3.0:1789181499.810527:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488052096 00010000:00010000:3.0:1789181499.810567:0:6707:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e41950 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f1ad expref: 23 pid: 5842 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181499.810607:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 60 00000100:00100000:3.0:1789181499.810617:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19619fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+23:2354:x1876092488052096:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789181499.810632:0:6707:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789181499.810639:0:6707:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e41950 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f1ad expref: 23 pid: 5842 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.810652:0:6707:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e41950 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f1ad expref: 23 pid: 5842 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.810673:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e41950 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f1ad expref: 23 pid: 5842 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.810688:0:6707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9dc192187c00) 00010000:00010000:3.0:1789181499.810693:0:6707:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e600/0x8f4f7840b2e41a45 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.810703:0:6707:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e600/0x8f4f7840b2e41a45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.810710:0:6707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e600/0x8f4f7840b2e41a45 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181499.811406:0:6707:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789181499.811465:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19619fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+22:2354:x1876092488052096:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 848us (1147us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181499.811474:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 60 00010000:00010000:0.0:1789181499.815750:0:6887:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e600/0x8f4f7840b2e41a45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181499.815767:0:6887:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e600/0x8f4f7840b2e41a45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789181499.818144:0:6887:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1789181499.818156:0:6887:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789181499.818186:0:6887:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e600/0x8f4f7840b2e41a45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181499.818204:0:6887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e600/0x8f4f7840b2e41a45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181499.818214:0:6887:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e41a37 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181499.818222:0:6887:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e41a37 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181499.818230:0:6887:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e41a37 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181499.818236:0:6887:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1bfa1ee00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:1.0:1789181499.818240:0:6887:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e41a37 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181499.818248:0:6887:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e41a37 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181499.818263:0:6887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9dc1995b7200) 00010000:00010000:1.0:1789181499.818267:0:6887:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789181499.818271:0:6887:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e41a37 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181499.818294:0:6887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e41a37 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181499.818311:0:6887:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e41a3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181499.818317:0:6887:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e41a3e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181499.818323:0:6887:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e41a3e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181499.818327:0:6887:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1bfa1fe00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:1.0:1789181499.818406:0:6887:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e41a3e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181499.818414:0:6887:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e41a3e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181499.818423:0:6887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9dc192187f00) 00010000:00010000:1.0:1789181499.818426:0:6887:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789181499.818429:0:6887:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e41a3e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181499.818435:0:6887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e41a3e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181499.818479:0:6887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e41a30 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f1ec expref: 22 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181499.818493:0:6887:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e600/0x8f4f7840b2e41a45 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f1ec expref: 21 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181499.818507:0:6887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9dc192187c00) 00010000:00010000:1.0:1789181499.818509:0:6887:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789181499.818524:0:6887:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1bfa1e600, rc 0) 00000100:00100000:1.0:1789181499.818600:0:6887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1a730ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+21:10553:x1876092488051712:12345-192.168.204.32@tcp:101:lfs.0 Request processed in 19161us (24676us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181499.818608:0:6887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 129 00010000:00010000:2.0:1789181499.966490:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181500.419138:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfb2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1876092510082816:0@lo:400:kworker.0 00000100:00100000:2.0:1789181500.419216:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181500.419268:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789181500.419274:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfa63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876092510082688:0@lo:400:kworker.0 00000100:00100000:2.0:1789181500.419293:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181500.419319:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1baadd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876092510083200:0@lo:400:kworker.0 00000100:00100000:2.0:1789181500.419364:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181500.419402:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510082816 00000100:00100000:2.0:1789181500.419410:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510082816 00000100:00100000:2.0:1789181500.419473:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510082688 00000100:00100000:2.0:1789181500.419477:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510082688 00000100:00100000:2.0:1789181500.419493:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1789181500.419500:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1baadca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876092510082816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181500.419546:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1baadca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876092510082816:12345-0@lo:400:kworker.0 Request processed in 46us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181500.419552:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1789181500.419567:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789181500.419573:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1baadc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876092510082688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181500.419596:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1baadc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876092510082688:12345-0@lo:400:kworker.0 Request processed in 23us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181500.419601:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789181500.419617:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510083200 00000100:00100000:2.0:1789181500.419620:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510083200 00000100:00100000:2.0:1789181500.419641:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789181500.419647:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1baadea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3304:x1876092510083200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181500.419676:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1baadea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3304:x1876092510083200:12345-0@lo:400:kworker.0 Request processed in 29us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181500.419682:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789181500.419720:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfa63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876092510082688:0@lo:400:kworker.0 00000100:00100000:2.0:1789181500.419732:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1baadd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876092510083200:0@lo:400:kworker.0 00000100:00100000:2.0:1789181500.419740:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfb2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1876092510082816:0@lo:400:kworker.0 00000100:00100000:1.0:1789181500.419863:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfa60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:880710ad-110c-42a4-a174-ab1b99a7ebeb:3306:1876092510082560:0@lo:400:kworker.0 00000100:00100000:1.0:1789181500.419898:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181500.419930:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1baadce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1876092510083072:0@lo:400:kworker.0 00000100:00100000:1.0:1789181500.419951:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181500.419970:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789181500.419975:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfb2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876092510082944:0@lo:400:kworker.0 00000100:00100000:1.0:1789181500.420010:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181500.420062:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510083072 00000100:00100000:1.0:1789181500.420066:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510083072 00000100:00100000:1.0:1789181500.420092:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1789181500.420098:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b66df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876092510083072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181500.420133:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b66df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876092510083072:12345-0@lo:400:kworker.0 Request processed in 35us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181500.420139:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00080000:1.0:1789181500.420156:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789181500.420174:0:6894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510082944 00000100:00100000:1.0:1789181500.420177:0:6894:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510082944 00000100:00100000:1.0:1789181500.420206:0:6894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789181500.420212:0:6894:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0833d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3306:x1876092510082944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181500.420252:0:6894:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0833d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3306:x1876092510082944:12345-0@lo:400:kworker.0 Request processed in 40us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181500.420258:0:6894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:1.0:1789181500.420273:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789181500.420289:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfb2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876092510082944:0@lo:400:kworker.0 00000100:00100000:1.0:1789181500.420298:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1baadce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1876092510083072:0@lo:400:kworker.0 00000100:00100000:2.0:1789181500.422675:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510082560 00000100:00100000:2.0:1789181500.422690:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510082560 00000100:00100000:2.0:1789181500.422752:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1789181500.422762:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:3306:x1876092510082560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181500.422870:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:3306:x1876092510082560:12345-0@lo:400:kworker.0 Request processed in 110us (2971us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181500.422878:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1789181500.423439:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfa60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:880710ad-110c-42a4-a174-ab1b99a7ebeb:3306:1876092510082560:0@lo:400:kworker.0 00000040:00080000:1.0:1789181500.674917:0:12115:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789181500.674925:0:12115:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789181500.675054:0:12115:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1789181500.675121:0:12115:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1789181500.798736:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789181500.798745:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789181500.798779:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1789181500.798786:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789181500.798915:0:11694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1a730a680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11694:1876092510083328:192.168.204.32@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789181500.799011:0:11694:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc189899d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789181500.806858:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181500.806897:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488052224 00000100:00100000:1.0:1789181500.806907:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488052224 00000100:00100000:1.0:1789181500.806962:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 130 00000100:00100000:1.0:1789181500.806972:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0833d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+22:10565:x1876092488052224:12345-192.168.204.32@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789181500.807007:0:5844:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789181500.807122:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0833d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+22:10565:x1876092488052224:12345-192.168.204.32@tcp:53:lhsmtool_posix.0 Request processed in 152us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181500.807131:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 130 00000100:00100000:3.0:1789181500.807572:0:11694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1a730a680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11694:1876092510083328:192.168.204.32@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789181500.812158:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181500.812694:0:6887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488052480 00000100:00100000:1.0:1789181500.812706:0:6887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488052480 00000100:00100000:1.0:1789181500.812763:0:6887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 131 00000100:00100000:1.0:1789181500.812773:0:6887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1a730b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+21:10565:x1876092488052480:12345-192.168.204.32@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789181500.812793:0:6887:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181500.812842:0:6887:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151aa00/0x8f4f7840b2e41a4c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f1f3 expref: -99 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181500.812951:0:6887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ac00/0x8f4f7840b2e41a53 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181500.812965:0:6887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ac00/0x8f4f7840b2e41a53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181500.812978:0:6887:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ac00/0x8f4f7840b2e41a53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789181500.812990:0:6887:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1789181500.813124:0:6887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151aa00/0x8f4f7840b2e41a4c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f1f3 expref: 24 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181500.813142:0:6887:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ac00/0x8f4f7840b2e41a53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f1f3 expref: 23 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181500.813149:0:6887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9dc192187c00) 00010000:00010000:1.0:1789181500.813152:0:6887:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789181500.813156:0:6887:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc18151ac00, rc 0) 00000100:00100000:1.0:1789181500.813211:0:6887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1a730b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+23:10565:x1876092488052480:12345-192.168.204.32@tcp:101:lhsmtool_posix.0 Request processed in 439us (1063us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1789181500.813218:0:6887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 131 00000100:00100000:1.0:1789181500.817567:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181500.818361:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488052608 00000100:00100000:2.0:1789181500.818373:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488052608 00000100:00100000:2.0:1789181500.818441:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9 00000100:00100000:2.0:1789181500.818453:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0833d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+23:2352:x1876092488052608:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789181500.818469:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789181500.818496:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ac00/0x8f4f7840b2e41a53 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f1f3 expref: 23 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181500.818804:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9dc192187c00) 00010000:00010000:2.0:1789181500.818811:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789181500.818878:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0833d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+22:2352:x1876092488052608:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 427us (1319us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181500.818887:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9 00000100:00100000:1.0:1789181500.819467:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181500.819492:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488052864 00000100:00100000:1.0:1789181500.819497:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488052864 00000100:00100000:1.0:1789181500.819531:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 132 00000100:00100000:1.0:1789181500.819546:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0833d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+22:10565:x1876092488052864:12345-192.168.204.32@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789181500.819616:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151a600/0x8f4f7840b2e41a61 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181500.819631:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151a600/0x8f4f7840b2e41a61 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181500.819643:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151a600/0x8f4f7840b2e41a61 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181500.820109:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151a600/0x8f4f7840b2e41a61 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181500.820119:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151a600/0x8f4f7840b2e41a61 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181500.820129:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151a600/0x8f4f7840b2e41a61 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181500.820135:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc18151a600 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:1.0:1789181500.820140:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151a600/0x8f4f7840b2e41a61 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181500.820147:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151a600/0x8f4f7840b2e41a61 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181500.820159:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9dc192187c00) 00010000:00010000:1.0:1789181500.820161:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789181500.820166:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151a600/0x8f4f7840b2e41a61 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181500.820172:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151a600/0x8f4f7840b2e41a61 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181500.820308:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0833d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+23:10565:x1876092488052864:12345-192.168.204.32@tcp:57:lhsmtool_posix.0 Request processed in 762us (841us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1789181500.820315:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 132 00000040:00080000:2.0:1789181500.820571:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789181500.820576:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789181500.821637:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1789181500.821652:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789181500.825195:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181500.825372:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488053120 00000100:00100000:2.0:1789181500.825382:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488053120 00000100:00100000:1.0:1789181500.825731:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 34 00000100:00100000:1.0:1789181500.825743:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0833d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+23:10565:x1876092488053120:12345-192.168.204.32@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789181500.825966:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0833d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+24:10565:x1876092488053120:12345-192.168.204.32@tcp:35:lhsmtool_posix.0 Request processed in 226us (783us total) trans 4294967412 rc 0/0 00000100:00100000:1.0:1789181500.825974:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 34 00000004:00080000:1.0:1789181500.927986:0:8013:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 393184652296ns, next at 394184649546ns, rc = 0 00000100:00100000:3.0:1789181500.928073:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789181500.928098:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0833d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876092510083456:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789181500.928185:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181500.928240:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510083456 00000100:00100000:1.0:1789181500.928250:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510083456 00000100:00100000:1.0:1789181500.928307:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789181500.928317:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1988c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1876092510083456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789181500.928389:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789181500.928447:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1988c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1876092510083456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 132us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181500.928454:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789181500.928623:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc0833d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876092510083456:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789181500.994734:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181502.015287:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789181502.687141:0:12167:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789181502.687154:0:12167:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789181502.687203:0:12167:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1789181502.687210:0:12167:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789181502.876462:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181502.876573:0:6887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488053376 00000100:00100000:3.0:1789181502.876584:0:6887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488053376 00000100:00100000:3.0:1789181502.876649:0:6887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 133 00000100:00100000:3.0:1789181502.876660:0:6887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0833d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+24:10585:x1876092488053376:12345-192.168.204.32@tcp:101:lfs.0 00010000:00010000:3.0:1789181502.876685:0:6887:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181502.876705:0:6887:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ea00/0x8f4f7840b2e41a68 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f1fa expref: -99 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181502.876808:0:6887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e41a6f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181502.876824:0:6887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e41a6f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181502.876855:0:6887:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e41a6f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789181502.876868:0:6887:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000100:00080000:0.0:1789181502.877001:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789181502.877228:0:6887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ea00/0x8f4f7840b2e41a68 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f1fa expref: 27 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181502.877248:0:6887:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e41a6f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f1fa expref: 26 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181502.877256:0:6887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9dc192187c00) 00010000:00010000:3.0:1789181502.877259:0:6887:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789181502.877262:0:6887:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1bfa1f000, rc 0) 00000100:00100000:3.0:1789181502.877324:0:6887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0833d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+26:10585:x1876092488053376:12345-192.168.204.32@tcp:101:lfs.0 Request processed in 667us (873us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1789181502.877360:0:6887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 133 00000100:00100000:3.0:1789181502.883054:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181502.883178:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488053504 00000100:00100000:1.0:1789181502.883189:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488053504 00000100:00100000:1.0:1789181502.883253:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 134 00000100:00100000:1.0:1789181502.883264:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1988c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+26:10585:x1876092488053504:12345-192.168.204.32@tcp:54:lfs.0 00010000:00010000:1.0:1789181502.883361:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151a000/0x8f4f7840b2e41a7d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181502.883390:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151a000/0x8f4f7840b2e41a7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181502.883402:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151a000/0x8f4f7840b2e41a7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181502.883430:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151a000/0x8f4f7840b2e41a7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181502.883438:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151a000/0x8f4f7840b2e41a7d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181502.883444:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151a000/0x8f4f7840b2e41a7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181502.883451:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc18151a000 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:1.0:1789181502.883454:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151a000/0x8f4f7840b2e41a7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181502.883461:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151a000/0x8f4f7840b2e41a7d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181502.883473:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9dc192187c00) 00010000:00010000:1.0:1789181502.883477:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789181502.883481:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151a000/0x8f4f7840b2e41a7d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181502.883488:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151a000/0x8f4f7840b2e41a7d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181502.883569:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1988c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+26:10585:x1876092488053504:12345-192.168.204.32@tcp:54:lfs.0 Request processed in 307us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181502.883584:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 134 00010000:00010000:2.0:1789181503.038712:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181503.046738:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181503.047303:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488053632 00000100:00100000:2.0:1789181503.047317:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488053632 00000100:00100000:2.0:1789181503.047431:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 46 00000100:00100000:2.0:1789181503.047459:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1a7308000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+6:2353:x1876092488053632:12345-192.168.204.32@tcp:101:cat.0 00010000:00010000:2.0:1789181503.047478:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181503.047496:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cf918e38/0x8f4f7840b2e41a84 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f201 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789181503.047522:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aa4be3c, atime: 0x6aa4be3b, ctime: 0x6aa4be3c, blocks: 0xb 00010000:00010000:2.0:1789181503.047541:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=395s v=(0 0) 00010000:00010000:2.0:1789181503.047546:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789181503.047555:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf918e38/0x8f4f7840b2e41a84 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f201 expref: 7 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181503.047573:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cf918e38/0x8f4f7840b2e41a84 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f201 expref: 7 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181503.047586:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1ba784000, rc 0) 00000100:00100000:2.0:1789181503.047655:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1a7308000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+7:2353:x1876092488053632:12345-192.168.204.32@tcp:101:cat.0 Request processed in 199us (928us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181503.047662:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 46 00000100:00080000:0.0:1789181503.047921:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789181503.058023:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181503.058831:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488053760 00000100:00100000:2.0:1789181503.058844:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488053760 00002000:00100000:2.0:1789181503.058898:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff9dc1a730aa00 x1876092488053760/t0(0) o3->5971a429-48ca-4c07-88a3-fa58102a53bc@192.168.204.32@tcp:634/0 lens 488/0 e 0 to 0 dl 1789181514 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789181503.058919:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9dc1a730aa00 with x1876092488053760 ext(0->4095) 00002000:00010000:2.0:1789181503.058926:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9dc1a730aa00 00000100:00100000:2.0:1789181503.058959:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 4 00000100:00100000:2.0:1789181503.058968:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1a730aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+7:2354:x1876092488053760:12345-192.168.204.32@tcp:3:cat.0 00000100:00100000:2.0:1789181503.060908:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1a730aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+7:2354:x1876092488053760:12345-192.168.204.32@tcp:3:cat.0 Request processed in 1931us (2897us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789181503.061221:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 4 00002000:00100000:2.0:1789181503.061233:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff9dc1a730aa00 x1876092488053760/t0(0) o3->5971a429-48ca-4c07-88a3-fa58102a53bc@192.168.204.32@tcp:634/0 lens 488/4536 e 0 to 0 dl 1789181514 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789181503.061243:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9dc1a730aa00 with x1876092488053760 ext(0->4095) 00002000:00010000:2.0:1789181503.061249:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9dc1a730aa00 00000100:00100000:3.0:1789181503.487744:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789181503.488701:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1baadd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876092510083584:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789181503.488849:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181503.489028:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510083584 00000100:00100000:2.0:1789181503.489040:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510083584 00000100:00100000:2.0:1789181503.489109:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789181503.489120:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1988c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1876092510083584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789181503.489167:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789181503.489225:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1988c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1876092510083584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181503.489232:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789181503.489385:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1baadd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876092510083584:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789181503.489553:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789181504.064516:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789181504.100033:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000100:00100000:3.0:1789181504.601387:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181504.601437:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181504.601466:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181504.601562:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181504.601585:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488054144 00000100:00100000:1.0:1789181504.601615:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488053888 00000100:00100000:1.0:1789181504.601622:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488053888 00000100:00100000:0.0:1789181504.601663:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488054144 00000100:00100000:1.0:1789181504.601674:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 290 00000100:00100000:1.0:1789181504.601684:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:975a0591-a8f7-4a74-9f93-a5aa77f2315c+13:2353:x1876092488053888:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:0.0:1789181504.601704:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 81 00000100:00100000:0.0:1789181504.601711:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1988c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+5:2353:x1876092488054144:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:1.0:1789181504.601757:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:975a0591-a8f7-4a74-9f93-a5aa77f2315c+13:2353:x1876092488053888:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 74us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181504.601765:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 290 00000100:00100000:0.0:1789181504.601845:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1988c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+5:2353:x1876092488054144:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 133us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181504.602698:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 81 00000100:00080000:0.0:1789181504.602735:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789181504.607978:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181504.608093:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488054272 00000100:00100000:0.0:1789181504.608102:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488054272 00000100:00100000:0.0:1789181504.608260:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 82 00000100:00100000:0.0:1789181504.608271:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1988c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+7:2353:x1876092488054272:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:0.0:1789181504.608357:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1988c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+7:2353:x1876092488054272:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 88us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181504.608365:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 82 00000100:00100000:2.0:1789181504.610832:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488054400 00000100:00100000:2.0:1789181504.610846:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488054400 00000100:00100000:2.0:1789181504.610928:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488054016 00000100:00100000:2.0:1789181504.610931:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488054016 00000100:00100000:2.0:1789181504.610971:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 141 00000100:00100000:2.0:1789181504.610981:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1988c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7badad21-a177-49b1-a2af-7b11e28c02ce+5:2353:x1876092488054400:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:2.0:1789181504.611058:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1988c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7badad21-a177-49b1-a2af-7b11e28c02ce+5:2353:x1876092488054400:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 80us (9592us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181504.611065:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 141 00000100:00100000:2.0:1789181504.611082:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 142 00000100:00100000:2.0:1789181504.611104:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1988c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+26:2353:x1876092488054016:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:2.0:1789181504.611131:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1988c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+26:2353:x1876092488054016:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 28us (9580us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181504.611137:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 142 00000100:00080000:3.0:1789181504.613702:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:1.0:1789181505.086282:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:1.0:1789181505.086299:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00010000:00010000:1.0:1789181505.086524:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789181505.098111:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967408 is committed 00000004:00080000:1.0:1789181505.098133:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000001:00080000:1.0:1789181505.098145:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967412 is committed 00000020:00080000:1.0:1789181505.098160:0:5865:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000001:00080000:1.0:1789181505.098173:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:1.0:1789181505.098189:0:5865:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9dc1aa4c70c0 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1789181505.098194:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9dc1bfa04b00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9dc1aa4c7540 00000020:00080000:1.0:1789181505.098197:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9dc1bfa04200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9dc1bfc23800 00000020:00080000:1.0:1789181505.098270:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:1.0:1789181505.098818:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:1.0:1789181505.098906:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0833d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876092510083712:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789181505.099050:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181505.109605:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510083712 00000100:00100000:0.0:1789181505.109622:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510083712 00000100:00100000:0.0:1789181505.109702:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789181505.109712:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0833d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876092510083712:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1789181505.110021:0:6692:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1789181505.110026:0:6692:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1789181500 -> 1789181500 00002000:00010000:0.0:1789181505.110028:0:6692:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 1789181499 -> 1789181499 00002000:00010000:0.0:1789181505.110030:0:6692:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1789181500 -> 1789181500 00002000:00010000:0.0:1789181505.110032:0:6692:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1789181505.110110:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0833d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3306:x1876092510083712:12345-0@lo:2:osp-syn-1-0.0 Request processed in 400us (11060us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1789181505.110119:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:0.0:1789181505.110158:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789181505.110268:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:0.0:1789181505.110274:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:0.0:1789181505.110298:0:3306:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9dc0833d2d80 x1876092510083712/t4294967313(4294967313) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1789181521 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1789181505.110311:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9dc0833d2d80/2, rc 0, transno 4294967313 00000100:00100000:0.0:1789181505.110316:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc0833d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876092510083712:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789181505.539307:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1baadd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:880710ad-110c-42a4-a174-ab1b99a7ebeb:3303:1876092510083840:0@lo:400:kworker.0 00000100:00100000:2.0:1789181505.539396:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181505.539439:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfb2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1876092510084352:0@lo:400:kworker.0 00000100:00100000:2.0:1789181505.539468:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181505.539610:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789181505.539618:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1baadd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876092510083968:0@lo:400:kworker.0 00000100:00100000:2.0:1789181505.539642:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181505.539679:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510083840 00000100:00100000:2.0:1789181505.539687:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510083840 00000100:00100000:2.0:1789181505.539731:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1789181505.539740:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:3303:x1876092510083840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181505.539788:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:3303:x1876092510083840:12345-0@lo:400:kworker.0 Request processed in 49us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181505.539795:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1789181505.539827:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510084352 00000100:00100000:2.0:1789181505.539831:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510084352 00000100:00100000:2.0:1789181505.539862:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510083968 00000100:00100000:2.0:1789181505.539865:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510083968 00000100:00100000:2.0:1789181505.539884:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789181505.539890:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfa60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876092510084352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181505.539923:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfa60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876092510084352:12345-0@lo:400:kworker.0 Request processed in 33us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181505.539954:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789181505.540098:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789181505.540105:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfa63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876092510083968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181505.540136:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfa63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876092510083968:12345-0@lo:400:kworker.0 Request processed in 32us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181505.540142:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789181505.540184:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1baadd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876092510083968:0@lo:400:kworker.0 00000100:00100000:2.0:1789181505.540194:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1baadd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:880710ad-110c-42a4-a174-ab1b99a7ebeb:3303:1876092510083840:0@lo:400:kworker.0 00000100:00100000:2.0:1789181505.540204:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfb2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1876092510084352:0@lo:400:kworker.0 00000100:00100000:1.0:1789181505.540289:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1baadce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1876092510084096:0@lo:400:kworker.0 00000100:00100000:1.0:1789181505.540321:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789181505.540415:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789181505.540428:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfb2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876092510084224:0@lo:400:kworker.0 00000100:00100000:2.0:1789181505.540465:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181505.540613:0:6887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510084096 00000100:00100000:1.0:1789181505.540618:0:6887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510084096 00000100:00100000:3.0:1789181505.540674:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510084224 00000100:00100000:3.0:1789181505.540678:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510084224 00000100:00100000:3.0:1789181505.540708:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789181505.540716:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876092510084224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181505.540764:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876092510084224:12345-0@lo:400:kworker.0 Request processed in 50us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181505.540770:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000100:00100000:3.0:1789181505.540771:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000004:00080000:2.0:1789181505.540775:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9dc1bfb7ed80, transno 4294967304 00000100:00100000:2.0:1789181505.540786:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfb2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876092510084224:0@lo:400:kworker.0 00000100:00100000:1.0:1789181505.540850:0:6887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789181505.540858:0:6887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0833d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876092510084096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181505.540896:0:6887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0833d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876092510084096:12345-0@lo:400:kworker.0 Request processed in 39us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181505.540902:0:6887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:1.0:1789181505.541030:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789181505.541036:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789181505.541057:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1baadce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1876092510084096:0@lo:400:kworker.0 00000100:00100000:3.0:1789181506.047709:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1988c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876092510084480:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789181506.047774:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181506.047845:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510084480 00000100:00100000:3.0:1789181506.047853:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510084480 00000100:00100000:3.0:1789181506.047895:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789181506.047904:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1988c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1876092510084480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789181506.047948:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789181506.050448:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1988c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1876092510084480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2538us (2666us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181506.050460:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789181506.050525:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1988c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876092510084480:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789181506.111540:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181507.136658:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181507.856003:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181507.856111:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488054528 00000100:00100000:2.0:1789181507.856121:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488054528 00000100:00100000:2.0:1789181507.856195:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 135 00000100:00100000:2.0:1789181507.856205:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1a730a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+13:10229:x1876092488054528:12345-192.168.204.32@tcp:60:lhsmtool_posix.0 00000100:00080000:1.0:1789181507.856839:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789181507.857147:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1a730a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+13:10229:x1876092488054528:12345-192.168.204.32@tcp:60:lhsmtool_posix.0 Request processed in 942us (1151us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181507.857176:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 135 00000100:00100000:0.0:1789181507.863268:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181507.863491:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488054784 00000100:00100000:1.0:1789181507.863501:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488054784 00000100:00100000:1.0:1789181507.864113:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 35 00000100:00100000:1.0:1789181507.864126:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1a7308700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+13:10229:x1876092488054784:12345-192.168.204.32@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789181507.864749:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1a7308700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+14:10229:x1876092488054784:12345-192.168.204.32@tcp:35:lhsmtool_posix.0 Request processed in 622us (1485us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1789181507.864756:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 35 00010000:00010000:2.0:1789181508.158808:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181508.608087:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789181508.608125:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfb2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876092510084608:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789181508.608193:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181508.611221:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510084608 00000100:00100000:2.0:1789181508.611239:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510084608 00000100:00100000:2.0:1789181508.611740:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789181508.611753:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0833d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876092510084608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789181508.611795:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789181508.611899:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0833d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876092510084608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 149us (3705us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181508.611916:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:1.0:1789181508.611991:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789181508.612252:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfb2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876092510084608:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1789181508.991141:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789181508.991150:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789181508.991462:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:0.0:1789181508.991470:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1789181509.183166:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181509.726258:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181509.726386:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488054912 00000100:00100000:2.0:1789181509.726396:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488054912 00000100:00100000:2.0:1789181509.726455:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 292 00000100:00100000:2.0:1789181509.726466:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c270050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:975a0591-a8f7-4a74-9f93-a5aa77f2315c+13:2354:x1876092488054912:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:2.0:1789181509.726528:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c270050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:975a0591-a8f7-4a74-9f93-a5aa77f2315c+13:2354:x1876092488054912:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 64us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181509.726535:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 292 00000100:00100000:0.0:1789181509.732313:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181509.732540:0:6887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488055040 00000100:00100000:1.0:1789181509.732551:0:6887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488055040 00000100:00100000:1.0:1789181509.732627:0:6887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 146 00000100:00100000:1.0:1789181509.732639:0:6887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c026dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+14:2354:x1876092488055040:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:1.0:1789181509.732724:0:6887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c026dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+14:2354:x1876092488055040:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 87us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181509.732750:0:6887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 146 00000100:00080000:2.0:1789181509.733184:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789181509.744324:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181509.744396:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181509.744431:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181509.744569:0:6894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488055296 00000100:00100000:3.0:1789181509.744580:0:6894:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488055296 00000100:00100000:3.0:1789181509.744646:0:6894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488055168 00000100:00100000:3.0:1789181509.744650:0:6894:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488055168 00000100:00100000:3.0:1789181509.744674:0:6894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 84 00000100:00100000:3.0:1789181509.744686:0:6894:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+6:2353:x1876092488055296:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:3.0:1789181509.744775:0:6894:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+6:2353:x1876092488055296:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 92us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181509.744794:0:6894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 84 00000100:00100000:3.0:1789181509.744812:0:6894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 85 00000100:00100000:3.0:1789181509.744819:0:6894:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1baadce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+5:2354:x1876092488055168:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:3.0:1789181509.744855:0:6894:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1baadce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+5:2354:x1876092488055168:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 27us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181509.744861:0:6894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 85 00000100:00100000:3.0:1789181509.744881:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488055424 00000100:00100000:3.0:1789181509.744884:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488055424 00000100:00100000:3.0:1789181509.745147:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 147 00000100:00100000:3.0:1789181509.745155:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1baadd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7badad21-a177-49b1-a2af-7b11e28c02ce+5:2354:x1876092488055424:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:3.0:1789181509.745187:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1baadd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7badad21-a177-49b1-a2af-7b11e28c02ce+5:2354:x1876092488055424:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 33us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181509.745193:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 147 00000100:00080000:2.0:1789181509.745661:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789181509.745667:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789181509.745670:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789181510.207578:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789181510.208969:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:1.0:1789181510.229634:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:1.0:1789181510.229645:0:5865:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:0.0:1789181510.229700:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1789181510.229712:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000001:02000400:3.0:1789181510.282264:0:12370:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 22:51:49 (1789181509) 00000100:00100000:2.0:1789181510.654623:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfa2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1876092510084992:0@lo:400:kworker.0 00000100:00100000:2.0:1789181510.654707:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181510.654886:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1ba4a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510085120:0@lo:400:kworker.0 00000100:00100000:3.0:1789181510.654927:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181510.654960:0:6894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510085120 00000100:00100000:3.0:1789181510.654967:0:6894:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510085120 00000100:00100000:3.0:1789181510.655025:0:6894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789181510.655034:0:6894:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1988c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510085120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181510.655080:0:6894:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1988c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510085120:12345-0@lo:400:kworker.0 Request processed in 47us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181510.655087:0:6894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789181510.655129:0:6887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510084992 00000100:00100000:3.0:1789181510.655141:0:6887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510084992 00000100:00100000:3.0:1789181510.655171:0:6887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789181510.655179:0:6887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1ba4a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876092510084992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181510.655208:0:6887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1ba4a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876092510084992:12345-0@lo:400:kworker.0 Request processed in 30us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181510.655213:0:6887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00080000:3.0:1789181510.655237:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789181510.655241:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789181510.655491:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1baadd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:880710ad-110c-42a4-a174-ab1b99a7ebeb:3306:1876092510084736:0@lo:400:kworker.0 00000100:00100000:0.0:1789181510.655528:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181510.655680:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfa2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876092510084864:0@lo:400:kworker.0 00000100:00100000:1.0:1789181510.655711:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181510.655791:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510084864 00000100:00100000:0.0:1789181510.655795:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510084864 00000100:00100000:0.0:1789181510.655840:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789181510.655847:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0833d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876092510084864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181510.655895:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0833d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876092510084864:12345-0@lo:400:kworker.0 Request processed in 48us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181510.655901:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789181510.656202:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfa2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1876092510084992:0@lo:400:kworker.0 00000100:00100000:3.0:1789181510.656283:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510084736 00000100:00100000:3.0:1789181510.656289:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510084736 00000100:00100000:3.0:1789181510.656327:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1789181510.656372:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c270450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:3306:x1876092510084736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181510.656412:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c270450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:3306:x1876092510084736:12345-0@lo:400:kworker.0 Request processed in 43us (883us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181510.656418:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1789181510.656569:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1ba4a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510085120:0@lo:400:kworker.0 00000100:00100000:1.0:1789181510.656643:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1baadd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:880710ad-110c-42a4-a174-ab1b99a7ebeb:3306:1876092510084736:0@lo:400:kworker.0 00000100:00100000:1.0:1789181510.656653:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1ba4a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1876092510085248:0@lo:400:kworker.0 00000100:00100000:1.0:1789181510.656682:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181510.656772:0:6887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510085248 00000100:00100000:3.0:1789181510.656776:0:6887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510085248 00000100:00100000:3.0:1789181510.656821:0:6887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789181510.656827:0:6887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0833d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876092510085248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181510.656881:0:6887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0833d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876092510085248:12345-0@lo:400:kworker.0 Request processed in 54us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181510.656887:0:6887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789181510.657048:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1ba4a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1876092510085248:0@lo:400:kworker.0 00000100:00080000:2.0:1789181510.657099:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789181510.657396:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfa2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876092510084864:0@lo:400:kworker.0 00000100:00100000:0.0:1789181510.657404:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1ba4aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876092510085376:0@lo:400:kworker.0 00000100:00100000:0.0:1789181510.657433:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181510.659409:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510085376 00000100:00100000:3.0:1789181510.659425:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510085376 00000100:00080000:2.0:1789181510.659572:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789181510.659781:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789181510.659793:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6b51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1876092510085376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181510.659904:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6b51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1876092510085376:12345-0@lo:400:kworker.0 Request processed in 115us (2469us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181510.659935:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789181510.660021:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:0.0:1789181510.660034:0:3303:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9dc0833d2d80, transno 4294967313 00000100:00100000:0.0:1789181510.660060:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1ba4aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876092510085376:0@lo:400:kworker.0 00000100:00100000:0.0:1789181511.167205:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1988c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876092510085504:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789181511.167282:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181511.167449:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510085504 00000100:00100000:2.0:1789181511.167457:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510085504 00000100:00100000:2.0:1789181511.167509:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789181511.167518:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876092510085504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789181511.167553:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789181511.167611:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876092510085504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181511.167618:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789181511.168410:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1988c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876092510085504:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789181511.230548:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181512.254744:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181512.417268:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181512.417375:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488055680 00000100:00100000:3.0:1789181512.417387:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488055680 00000100:00100000:3.0:1789181512.417469:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 136 00000100:00100000:3.0:1789181512.417481:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+13:11298:x1876092488055680:12345-192.168.204.32@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789181512.417504:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181512.417527:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e41a8b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f208 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181512.417606:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ea00/0x8f4f7840b2e41a92 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181512.417621:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ea00/0x8f4f7840b2e41a92 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181512.417633:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ea00/0x8f4f7840b2e41a92 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181512.417649:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e41a99 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181512.417656:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e41a99 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181512.417663:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e41a99 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789181512.417965:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789181512.419058:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e41aa0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181512.419086:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e41aa0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181512.419096:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e41aa0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789181512.419107:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:3.0:1789181512.419252:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ea00/0x8f4f7840b2e41a92 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181512.419261:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ea00/0x8f4f7840b2e41a92 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181512.419268:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ea00/0x8f4f7840b2e41a92 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181512.419273:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1bfa1ea00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:3.0:1789181512.419278:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ea00/0x8f4f7840b2e41a92 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181512.419288:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ea00/0x8f4f7840b2e41a92 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181512.419301:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9dc1995b7600) 00010000:00010000:3.0:1789181512.419304:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181512.419309:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ea00/0x8f4f7840b2e41a92 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181512.419316:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ea00/0x8f4f7840b2e41a92 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181512.419959:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e41a99 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181512.419981:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e41a99 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181512.419988:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e41a99 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181512.419993:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1bfa1fe00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:3.0:1789181512.419996:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e41a99 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181512.420003:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e41a99 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181512.420013:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9dc192187800) 00010000:00010000:3.0:1789181512.420016:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181512.420020:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e41a99 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181512.420026:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e41a99 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181512.420512:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e41a8b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f208 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181512.420530:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e41aa0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f208 expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181512.420538:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9dc192187200) 00010000:00010000:3.0:1789181512.420541:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181512.420549:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1bfa1ee00, rc 0) 00000100:00100000:3.0:1789181512.420633:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+15:11298:x1876092488055680:12345-192.168.204.32@tcp:101:lhsmtool_posix.0 Request processed in 3155us (3376us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1789181512.420642:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 136 00000100:00100000:3.0:1789181512.426433:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181512.426771:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488055808 00000100:00100000:2.0:1789181512.426782:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488055808 00000100:00100000:2.0:1789181512.426859:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 10 00000100:00100000:2.0:1789181512.426869:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1988c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+15:2352:x1876092488055808:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789181512.426884:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789181512.426908:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e41aa0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f208 expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181512.426928:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9dc192187200) 00010000:00010000:2.0:1789181512.426934:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789181512.426995:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1988c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+14:2352:x1876092488055808:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 127us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181512.427003:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 10 00000100:00100000:0.0:1789181512.431161:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181512.431556:0:6887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488055936 00000100:00100000:3.0:1789181512.431566:0:6887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488055936 00000100:00100000:3.0:1789181512.431622:0:6887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 137 00000100:00100000:3.0:1789181512.431633:0:6887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+14:11298:x1876092488055936:12345-192.168.204.32@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1789181512.431728:0:6887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+14:11298:x1876092488055936:12345-192.168.204.32@tcp:59:lhsmtool_posix.0 Request processed in 98us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181512.431736:0:6887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 137 00000040:00080000:0.0:1789181513.090460:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789181513.090471:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789181513.090510:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:0.0:1789181513.090516:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1789181513.284491:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181513.731455:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1ba4aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510085632:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789181513.731528:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181513.731621:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510085632 00000100:00100000:3.0:1789181513.731630:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510085632 00000100:00100000:3.0:1789181513.731694:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789181513.731705:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1ba69d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510085632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789181513.731740:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1789181513.731812:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789181513.732275:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1ba69d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510085632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 570us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181513.732283:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789181513.732704:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1ba4aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510085632:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789181514.304014:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181514.497864:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181514.497939:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488056064 00000100:00100000:2.0:1789181514.497949:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488056064 00000100:00100000:2.0:1789181514.498030:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 138 00000100:00100000:2.0:1789181514.498041:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0833d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+14:11340:x1876092488056064:12345-192.168.204.32@tcp:101:lfs.0 00010000:00010000:2.0:1789181514.498061:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181514.498084:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785e00/0x8f4f7840b2e41aae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f20f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181514.498157:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e41ab5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181514.498172:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e41ab5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181514.498183:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e41ab5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181514.498198:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784200/0x8f4f7840b2e41abc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181514.498205:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784200/0x8f4f7840b2e41abc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181514.498211:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784200/0x8f4f7840b2e41abc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181514.498428:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e41ab5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181514.498437:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e41ab5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181514.498453:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e41ab5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181514.498460:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1ba785c00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:2.0:1789181514.498464:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e41ab5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181514.498473:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e41ab5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181514.498486:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc192187000) 00010000:00010000:2.0:1789181514.498489:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789181514.498494:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e41ab5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181514.498501:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e41ab5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181514.498514:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784200/0x8f4f7840b2e41abc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181514.498520:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784200/0x8f4f7840b2e41abc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181514.498526:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784200/0x8f4f7840b2e41abc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181514.498531:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1ba784200 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:2.0:1789181514.498534:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784200/0x8f4f7840b2e41abc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181514.498550:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784200/0x8f4f7840b2e41abc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181514.498558:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9dc1995b7c00) 00010000:00010000:2.0:1789181514.498560:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789181514.498564:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784200/0x8f4f7840b2e41abc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181514.498570:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784200/0x8f4f7840b2e41abc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181514.498601:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785e00/0x8f4f7840b2e41aae lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f20f expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181514.498611:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc192187000) 00010000:00010000:2.0:1789181514.498614:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789181514.498617:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785e00/0x8f4f7840b2e41aae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f20f expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181514.498626:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1ba785e00, rc 0) 00000100:00080000:1.0:1789181514.498959:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789181514.500104:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0833d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+14:11340:x1876092488056064:12345-192.168.204.32@tcp:101:lfs.0 Request processed in 2058us (2243us total) trans 0 rc 301/301 00000100:00100000:2.0:1789181514.500123:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 138 00000100:00100000:0.0:1789181514.514516:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181514.514801:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488056320 00000100:00100000:1.0:1789181514.514813:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488056320 00000100:00100000:1.0:1789181514.514868:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 139 00000100:00100000:1.0:1789181514.514878:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+14:11340:x1876092488056320:12345-192.168.204.32@tcp:36:lfs.0 00010000:00010000:1.0:1789181514.514948:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789181514.514973:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ec00/0x8f4f7840b2e4143a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f04f expref: 14 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181514.514991:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc192187000) 00010000:00010000:1.0:1789181514.515003:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789181514.515261:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e41ac3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181514.515275:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e41ac3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181514.515285:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e41ac3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181514.515297:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ac00/0x8f4f7840b2e41aca lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181514.515303:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ac00/0x8f4f7840b2e41aca lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181514.515310:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ac00/0x8f4f7840b2e41aca lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789181514.516259:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1789181514.516273:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e41ac3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181514.516281:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e41ac3 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181514.516288:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e41ac3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181514.516293:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc18151ae00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:1.0:1789181514.516298:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e41ac3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181514.516306:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e41ac3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181514.516326:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc18a6c2a00) 00010000:00010000:1.0:1789181514.516350:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789181514.516355:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e41ac3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181514.516362:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e41ac3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789181514.516384:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005083f53a reply state 00000000e9be7115 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ac00/0x8f4f7840b2e41aca lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181514.516392:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789181514.516482:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+15:11340:x1876092488056320:12345-192.168.204.32@tcp:36:lfs.0 Request processed in 1604us (1976us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1789181514.516490:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 139 00010000:00010000:3.0:1789181514.522139:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ac00/0x8f4f7840b2e41aca lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181514.522159:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ac00/0x8f4f7840b2e41aca lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181514.522175:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ac00/0x8f4f7840b2e41aca lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181514.522200:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc18151ac00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:3.0:1789181514.522206:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ac00/0x8f4f7840b2e41aca lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181514.522214:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ac00/0x8f4f7840b2e41aca lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181514.522230:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9dc18a6c2400) 00010000:00010000:3.0:1789181514.522234:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181514.522239:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ac00/0x8f4f7840b2e41aca lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181514.522246:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ac00/0x8f4f7840b2e41aca lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181514.618989:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181514.619147:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488056448 00000100:00100000:1.0:1789181514.619158:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488056448 00000100:00100000:1.0:1789181514.619243:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 140 00000100:00100000:1.0:1789181514.619254:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+14:11348:x1876092488056448:12345-192.168.204.32@tcp:101:lctl.0 00010000:00010000:1.0:1789181514.619279:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181514.619300:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e41ad1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f216 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181514.619565:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151a600/0x8f4f7840b2e41ad8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181514.619580:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151a600/0x8f4f7840b2e41ad8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181514.619602:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151a600/0x8f4f7840b2e41ad8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789181514.619640:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789181514.619645:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789181514.619666:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151a600/0x8f4f7840b2e41ad8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181514.619691:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e41ad1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f216 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181514.619710:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151a600/0x8f4f7840b2e41ad8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f216 expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181514.619719:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc18a6c2a00) 00010000:00010000:1.0:1789181514.619722:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789181514.619726:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc18151a600, rc 0) 00000100:00100000:1.0:1789181514.619844:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+15:11348:x1876092488056448:12345-192.168.204.32@tcp:101:lctl.0 Request processed in 592us (864us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181514.619852:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 140 00000100:00100000:3.0:1789181514.710073:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181514.710238:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488056576 00000100:00100000:2.0:1789181514.710251:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488056576 00000100:00100000:2.0:1789181514.710349:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 141 00000100:00100000:2.0:1789181514.710363:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1988c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+15:11354:x1876092488056576:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:2.0:1789181514.710409:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181514.710432:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785e00/0x8f4f7840b2e41adf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f21d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181514.710513:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784200/0x8f4f7840b2e41ae6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181514.710531:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784200/0x8f4f7840b2e41ae6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181514.710545:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784200/0x8f4f7840b2e41ae6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181514.710559:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e41aed lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181514.710566:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e41aed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181514.710573:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e41aed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181514.710681:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785600/0x8f4f7840b2e41af4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181514.710689:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785600/0x8f4f7840b2e41af4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181514.710696:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785600/0x8f4f7840b2e41af4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789181514.710723:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1789181514.710732:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789181514.710766:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785600/0x8f4f7840b2e41af4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181514.710779:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784200/0x8f4f7840b2e41ae6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181514.710785:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784200/0x8f4f7840b2e41ae6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181514.710956:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784200/0x8f4f7840b2e41ae6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181514.710963:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1ba784200 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:2.0:1789181514.710967:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784200/0x8f4f7840b2e41ae6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181514.710974:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784200/0x8f4f7840b2e41ae6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181514.710985:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc18a6c2a00) 00010000:00010000:2.0:1789181514.710987:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789181514.710991:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784200/0x8f4f7840b2e41ae6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181514.710997:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784200/0x8f4f7840b2e41ae6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181514.711009:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e41aed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181514.711016:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e41aed lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181514.711033:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e41aed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181514.711039:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1ba785c00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:2.0:1789181514.711042:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e41aed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181514.711048:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e41aed lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181514.711056:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9dc1995b7c00) 00010000:00010000:2.0:1789181514.711058:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789181514.711061:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e41aed lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181514.711066:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785c00/0x8f4f7840b2e41aed lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181514.711097:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785e00/0x8f4f7840b2e41adf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f21d expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181514.711239:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785600/0x8f4f7840b2e41af4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f21d expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181514.711247:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9dc1995b7800) 00010000:00010000:2.0:1789181514.711250:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789181514.711252:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1ba785600, rc 0) 00000100:00100000:2.0:1789181514.711486:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1988c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+16:11354:x1876092488056576:12345-192.168.204.32@tcp:101:bash.0 Request processed in 1125us (1423us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181514.711501:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 141 00000100:00100000:0.0:1789181514.715585:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181514.716729:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488056832 00000100:00100000:2.0:1789181514.716743:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488056832 00000100:00100000:2.0:1789181514.716885:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 142 00000100:00100000:2.0:1789181514.716971:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+16:11354:x1876092488056832:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:2.0:1789181514.716991:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181514.717012:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785a00/0x8f4f7840b2e41afb lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f224 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181514.717229:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258800/0x8f4f7840b2e41b02 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181514.717245:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258800/0x8f4f7840b2e41b02 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181514.717256:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258800/0x8f4f7840b2e41b02 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181514.717295:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259000/0x8f4f7840b2e41b09 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181514.717304:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259000/0x8f4f7840b2e41b09 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181514.717576:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259000/0x8f4f7840b2e41b09 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789181514.718615:0:5843:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:2.0:1789181514.718862:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258e00/0x8f4f7840b2e41b10 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181514.718882:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258e00/0x8f4f7840b2e41b10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181514.718966:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258e00/0x8f4f7840b2e41b10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181514.719007:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258800/0x8f4f7840b2e41b02 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181514.719015:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258800/0x8f4f7840b2e41b02 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181514.719022:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258800/0x8f4f7840b2e41b02 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181514.719028:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1c0258800 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:2.0:1789181514.719033:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258800/0x8f4f7840b2e41b02 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181514.719041:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258800/0x8f4f7840b2e41b02 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181514.719051:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9dc1995b7800) 00010000:00010000:2.0:1789181514.719055:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789181514.719059:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258800/0x8f4f7840b2e41b02 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181514.719065:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258800/0x8f4f7840b2e41b02 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789181514.719079:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e014b0f7 reply state 000000006058eded transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259000/0x8f4f7840b2e41b09 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181514.719093:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789181514.719131:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785a00/0x8f4f7840b2e41afb lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f224 expref: 19 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181514.719146:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258e00/0x8f4f7840b2e41b10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f224 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181514.719154:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9dc1995b7100) 00010000:00010000:2.0:1789181514.719156:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789181514.719158:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1c0258e00, rc 0) 00000100:00100000:2.0:1789181514.719395:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+19:11354:x1876092488056832:12345-192.168.204.32@tcp:101:bash.0 Request processed in 2427us (3820us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1789181514.719403:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 142 00010000:00010000:3.0:1789181514.721368:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259000/0x8f4f7840b2e41b09 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181514.721386:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259000/0x8f4f7840b2e41b09 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181514.721393:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259000/0x8f4f7840b2e41b09 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181514.721399:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1c0259000 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:3.0:1789181514.721403:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259000/0x8f4f7840b2e41b09 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181514.721411:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259000/0x8f4f7840b2e41b09 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181514.721437:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9dc1995b7300) 00010000:00010000:3.0:1789181514.721440:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181514.721444:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259000/0x8f4f7840b2e41b09 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181514.721451:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259000/0x8f4f7840b2e41b09 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181514.724768:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181514.725020:0:6894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488056960 00000100:00100000:3.0:1789181514.725106:0:6894:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488056960 00000100:00100000:3.0:1789181514.725236:0:6894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 48 00000100:00100000:3.0:1789181514.725248:0:6894:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b67a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+5:2353:x1876092488056960:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:3.0:1789181514.725267:0:6894:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181514.725288:0:6894:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002906dfa2/0x8f4f7840b2e41b1e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f22b expref: -99 pid: 6894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789181514.725347:0:6894:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789181514.725369:0:6894:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=406s v=(0 0) 00010000:00010000:3.0:1789181514.725374:0:6894:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789181514.725384:0:6894:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002906dfa2/0x8f4f7840b2e41b1e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f22b expref: 6 pid: 6894 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181514.725405:0:6894:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002906dfa2/0x8f4f7840b2e41b1e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f22b expref: 6 pid: 6894 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181514.725417:0:6894:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1bfa1fa00, rc 0) 00000100:00100000:3.0:1789181514.725478:0:6894:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b67a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+6:2353:x1876092488056960:12345-192.168.204.32@tcp:101:bash.0 Request processed in 232us (731us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181514.725498:0:6894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 48 00000100:00080000:1.0:1789181514.726124:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789181514.727569:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181514.727668:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488057088 00000100:00100000:1.0:1789181514.727677:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488057088 00000100:00100000:1.0:1789181514.727727:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 49 00000100:00100000:1.0:1789181514.727737:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1ba769180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+6:11354:x1876092488057088:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:1.0:1789181514.727761:0:6692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181514.727782:0:6692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059f46ab8/0x8f4f7840b2e41b25 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f232 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181514.727826:0:6692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002906dfa2/0x8f4f7840b2e41b1e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f22b expref: 7 pid: 6894 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181514.727836:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789181514.727840:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789181514.727844:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059f46ab8/0x8f4f7840b2e41b25 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f232 expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181514.727877:0:6692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002906dfa2/0x8f4f7840b2e41b1e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f22b expref: 7 pid: 6894 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181514.727890:0:6692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002906dfa2/0x8f4f7840b2e41b1e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f22b expref: 7 pid: 6894 timeout: 506 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181514.727904:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0833d0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6692:1876092510085760:192.168.204.32@tcp:104: 00000100:00100000:1.0:1789181514.727977:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc189bfd480 going to sleep for 11 seconds 00000100:00100000:2.0:1789181514.730898:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181514.730965:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc0833d0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6692:1876092510085760:192.168.204.32@tcp:104: 00010000:00010000:1.0:1789181514.731001:0:6692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000059f46ab8/0x8f4f7840b2e41b25 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f232 expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181514.731007:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488057216 00000100:00100000:3.0:1789181514.731014:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488057216 00010000:00010000:1.0:1789181514.731020:0:6692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc18151ae00, rc 0) 00010000:00010000:3.0:1789181514.731050:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002906dfa2/0x8f4f7840b2e41b1e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f22b expref: 8 pid: 6894 timeout: 506 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181514.731086:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 61 00000100:00100000:3.0:1789181514.731096:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1ba4a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+8:2353:x1876092488057216:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789181514.731203:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789181514.731209:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1ba769180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+8:11354:x1876092488057088:12345-192.168.204.32@tcp:101:bash.0 Request processed in 3474us (3648us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181514.731216:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 49 00010000:00010000:3.0:1789181514.731225:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002906dfa2/0x8f4f7840b2e41b1e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f22b expref: 8 pid: 6894 timeout: 506 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181514.731238:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002906dfa2/0x8f4f7840b2e41b1e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f22b expref: 8 pid: 6894 timeout: 506 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181514.731260:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002906dfa2/0x8f4f7840b2e41b1e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f22b expref: 7 pid: 6894 timeout: 506 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181514.731275:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789181514.731280:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789181514.731287:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000059f46ab8/0x8f4f7840b2e41b25 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f232 expref: 6 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181514.731297:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059f46ab8/0x8f4f7840b2e41b25 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f232 expref: 6 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181514.731380:0:5827:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000059f46ab8/0x8f4f7840b2e41b25 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f232 expref: 6 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181514.731394:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1988c2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5827:1876092510085888:192.168.204.32@tcp:105: 00000100:00100000:3.0:1789181514.731444:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1884b5480 going to sleep for 11 seconds 00000100:00100000:0.0:1789181514.735161:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181514.735263:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488057472 00000100:00100000:1.0:1789181514.735271:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488057472 00000100:00100000:1.0:1789181514.735358:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 36 00000100:00100000:1.0:1789181514.735370:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1ba76b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+18:11354:x1876092488057472:12345-192.168.204.32@tcp:35:bash.0 00000100:00100000:1.0:1789181514.735976:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1ba76b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+19:11354:x1876092488057472:12345-192.168.204.32@tcp:35:bash.0 Request processed in 606us (821us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1789181514.735986:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 36 00000100:00100000:3.0:1789181514.736365:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1988c2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5827:1876092510085888:192.168.204.32@tcp:105: 00010000:00010000:3.0:1789181514.736390:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789181514.736418:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1ba4a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+6:2353:x1876092488057216:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 5324us (5531us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181514.736426:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 61 00000100:00100000:0.0:1789181514.800053:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181514.800379:0:6887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488057728 00000100:00100000:3.0:1789181514.800391:0:6887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488057728 00000100:00100000:3.0:1789181514.800453:0:6887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 143 00000100:00100000:3.0:1789181514.800464:0:6887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1ba76aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+19:11364:x1876092488057728:12345-192.168.204.32@tcp:101:lfs.0 00010000:00010000:3.0:1789181514.800489:0:6887:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181514.800509:0:6887:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e41b2c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f239 expref: -99 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789181514.800606:0:6887:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1789181514.800722:0:6887:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e41b2c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f239 expref: 21 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181514.800743:0:6887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc18a6c2a00) 00010000:00010000:3.0:1789181514.800746:0:6887:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789181514.800775:0:6887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e41b2c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f239 expref: 21 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181514.800798:0:6887:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1bfa1fa00, rc 0) 00000100:00100000:3.0:1789181514.800849:0:6887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1ba76aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+20:11364:x1876092488057728:12345-192.168.204.32@tcp:101:lfs.0 Request processed in 388us (806us total) trans 4294967419 rc 301/301 00000100:00100000:3.0:1789181514.800856:0:6887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 143 00000100:00100000:2.0:1789181514.805226:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181514.805582:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488057984 00000100:00100000:3.0:1789181514.805592:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488057984 00000100:00100000:3.0:1789181514.805650:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 37 00000100:00100000:3.0:1789181514.805661:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1ba4a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+20:11364:x1876092488057984:12345-192.168.204.32@tcp:35:lfs.0 00000100:00100000:3.0:1789181514.805930:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1ba4a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+21:11364:x1876092488057984:12345-192.168.204.32@tcp:35:lfs.0 Request processed in 271us (715us total) trans 4294967420 rc 0/0 00000100:00100000:3.0:1789181514.805938:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 37 00000100:00100000:0.0:1789181514.839464:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181514.839568:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181514.839617:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181514.839813:0:6894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488058240 00000100:00100000:1.0:1789181514.839813:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488058368 00000100:00100000:2.0:1789181514.839824:0:6894:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488058240 00000100:00100000:1.0:1789181514.839824:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488058368 00000100:00100000:1.0:1789181514.839892:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 151 00000100:00100000:1.0:1789181514.839903:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1ba769880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7badad21-a177-49b1-a2af-7b11e28c02ce+5:2353:x1876092488058368:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:1.0:1789181514.839975:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1ba769880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7badad21-a177-49b1-a2af-7b11e28c02ce+5:2353:x1876092488058368:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 74us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181514.839982:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 151 00000100:00100000:0.0:1789181514.839987:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 88 00000100:00100000:0.0:1789181514.839996:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1ba769c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+6:2353:x1876092488058240:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:0.0:1789181514.840112:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1ba769c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+6:2353:x1876092488058240:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 118us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181514.840120:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 88 00000100:00080000:0.0:1789181514.840140:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789181514.840144:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789181514.841045:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488058112 00000100:00100000:3.0:1789181514.841056:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488058112 00000100:00100000:0.0:1789181514.841153:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 294 00000100:00100000:0.0:1789181514.841163:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c271c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:975a0591-a8f7-4a74-9f93-a5aa77f2315c+13:2353:x1876092488058112:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:0.0:1789181514.847429:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c271c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:975a0591-a8f7-4a74-9f93-a5aa77f2315c+13:2353:x1876092488058112:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 6144us (7852us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181514.847445:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 294 00000100:00100000:0.0:1789181514.911087:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181514.911180:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488058496 00000100:00100000:2.0:1789181514.911191:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488058496 00000100:00100000:2.0:1789181514.911256:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 144 00000100:00100000:2.0:1789181514.911267:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c071fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+21:11370:x1876092488058496:12345-192.168.204.32@tcp:101:lfs.0 00010000:00010000:2.0:1789181514.911293:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181514.911318:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258600/0x8f4f7840b2e41b3a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f240 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181514.911425:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258c00/0x8f4f7840b2e41b41 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181514.911446:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258c00/0x8f4f7840b2e41b41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181514.911461:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258c00/0x8f4f7840b2e41b41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789181514.911497:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1789181514.911501:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789181514.911518:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258c00/0x8f4f7840b2e41b41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181514.911545:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258600/0x8f4f7840b2e41b3a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f240 expref: 23 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181514.911564:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258c00/0x8f4f7840b2e41b41 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f240 expref: 22 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181514.911573:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9dc1995b7800) 00010000:00010000:2.0:1789181514.911576:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789181514.911579:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1c0258c00, rc 0) 00000100:00100000:2.0:1789181514.911777:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c071fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+22:11370:x1876092488058496:12345-192.168.204.32@tcp:101:lfs.0 Request processed in 511us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181514.911793:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 144 00000100:00100000:0.0:1789181514.917560:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181514.917715:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488058752 00000100:00100000:1.0:1789181514.917724:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488058752 00000100:00100000:1.0:1789181514.917876:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 145 00000100:00100000:1.0:1789181514.917888:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c071c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+22:11370:x1876092488058752:12345-192.168.204.32@tcp:101:lfs.0 00010000:00010000:1.0:1789181514.917911:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181514.917932:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151aa00/0x8f4f7840b2e41b48 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f247 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181514.918104:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ac00/0x8f4f7840b2e41b4f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181514.918119:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ac00/0x8f4f7840b2e41b4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181514.918149:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ac00/0x8f4f7840b2e41b4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789181514.918162:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1789181514.918560:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151aa00/0x8f4f7840b2e41b48 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f247 expref: 25 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181514.918585:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ac00/0x8f4f7840b2e41b4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f247 expref: 24 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181514.918594:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9dc1995b7100) 00010000:00010000:1.0:1789181514.918597:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789181514.918600:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc18151ac00, rc 0) 00000100:00100000:1.0:1789181514.918880:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c071c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+24:11370:x1876092488058752:12345-192.168.204.32@tcp:101:lfs.0 Request processed in 994us (1329us total) trans 4294967421 rc 0/0 00000100:00100000:1.0:1789181514.918888:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 145 00000100:00100000:3.0:1789181514.926713:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181514.926768:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181514.926958:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488059136 00000100:00100000:0.0:1789181514.926979:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488059136 00000100:00100000:0.0:1789181514.927048:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 11 00000100:00100000:0.0:1789181514.927060:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1988c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+24:2352:x1876092488059136:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789181514.927076:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789181514.927101:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ac00/0x8f4f7840b2e41b4f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f247 expref: 24 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181514.927124:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9dc1995b7100) 00010000:00010000:0.0:1789181514.927129:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789181514.927178:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1988c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+23:2352:x1876092488059136:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 121us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181514.927185:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 11 00000100:00100000:0.0:1789181514.927224:0:6887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488059008 00000100:00100000:0.0:1789181514.927227:0:6887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488059008 00000100:00100000:0.0:1789181514.927254:0:6887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 146 00000100:00100000:0.0:1789181514.927260:0:6887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1988c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+23:11370:x1876092488059008:12345-192.168.204.32@tcp:101:lfs.0 00010000:00010000:0.0:1789181514.927281:0:6887:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181514.927296:0:6887:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891000/0x8f4f7840b2e41b5d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f24e expref: -99 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181514.927422:0:6887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890400/0x8f4f7840b2e41b64 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181514.927436:0:6887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890400/0x8f4f7840b2e41b64 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181514.927446:0:6887:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890400/0x8f4f7840b2e41b64 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789181514.927457:0:6887:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1789181514.927583:0:6887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891000/0x8f4f7840b2e41b5d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f24e expref: 26 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181514.927597:0:6887:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890400/0x8f4f7840b2e41b64 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f24e expref: 25 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181514.927605:0:6887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9dc1995b7100) 00010000:00010000:0.0:1789181514.927608:0:6887:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789181514.927611:0:6887:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc189890400, rc 0) 00000100:00100000:0.0:1789181514.927635:0:6887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1988c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+25:11370:x1876092488059008:12345-192.168.204.32@tcp:101:lfs.0 Request processed in 376us (932us total) trans 4294967422 rc 0/0 00000100:00100000:0.0:1789181514.927651:0:6887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 146 00000100:00100000:0.0:1789181514.933396:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181514.933477:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488059264 00000100:00100000:3.0:1789181514.933488:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488059264 00000100:00100000:3.0:1789181514.933546:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 50 00000100:00100000:3.0:1789181514.933557:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c071df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+6:2354:x1876092488059264:12345-192.168.204.32@tcp:1:lfs.0 00010000:00010000:3.0:1789181514.933608:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002906dfa2/0x8f4f7840b2e41b72 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181514.933629:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000059f46ab8/0x8f4f7840b2e41b25 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f232 expref: 6 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181514.933671:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789181514.933676:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789181514.933681:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002906dfa2/0x8f4f7840b2e41b72 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181514.933722:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000059f46ab8/0x8f4f7840b2e41b25 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f232 expref: 6 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181514.933735:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000059f46ab8/0x8f4f7840b2e41b25 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f232 expref: 6 pid: 6692 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181514.933760:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1988c0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6691:1876092510086016:192.168.204.32@tcp:104: 00000100:00100000:3.0:1789181514.933868:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1884b5480 going to sleep for 11 seconds 00000100:00100000:0.0:1789181514.942473:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181514.942563:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1988c0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6691:1876092510086016:192.168.204.32@tcp:104: 00010000:00010000:3.0:1789181514.942592:0:6691:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002906dfa2/0x8f4f7840b2e41b72 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181514.943420:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488059392 00000100:00100000:1.0:1789181514.943429:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488059392 00002000:00100000:1.0:1789181514.943480:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9dc1c071d880 x1876092488059392/t0(0) o4->5971a429-48ca-4c07-88a3-fa58102a53bc@192.168.204.32@tcp:645/0 lens 504/0 e 0 to 0 dl 1789181525 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789181514.943489:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9dc1c071d880 with x1876092488059392 ext(0->12) 00010000:00010000:1.0:1789181514.943497:0:6698:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000059f46ab8/0x8f4f7840b2e41b25 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f232 expref: 7 pid: 6692 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181514.943512:0:6698:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000059f46ab8/0x8f4f7840b2e41b25 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f232 expref: 7 pid: 6692 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789181514.943537:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9dc1c071d880 00000100:00100000:1.0:1789181514.943618:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2 00000100:00100000:1.0:1789181514.943629:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c071d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+7:2354:x1876092488059392:12345-192.168.204.32@tcp:4:lfs.0 00000100:00100000:1.0:1789181514.944320:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c071d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+9:2354:x1876092488059392:12345-192.168.204.32@tcp:4:lfs.0 Request processed in 690us (1853us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1789181514.944578:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2 00002000:00100000:1.0:1789181514.944589:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9dc1c071d880 x1876092488059392/t4294967305(0) o4->5971a429-48ca-4c07-88a3-fa58102a53bc@192.168.204.32@tcp:645/0 lens 504/448 e 0 to 0 dl 1789181525 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789181514.944598:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9dc1c071d880 with x1876092488059392 ext(0->12) 00010000:00010000:1.0:1789181514.944606:0:6698:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000059f46ab8/0x8f4f7840b2e41b25 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f232 expref: 9 pid: 6692 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181514.944621:0:6698:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000059f46ab8/0x8f4f7840b2e41b25 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f232 expref: 9 pid: 6692 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789181514.944629:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9dc1c071d880 00000100:00100000:0.0:1789181514.955555:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181514.955706:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488059520 00000100:00100000:3.0:1789181514.955716:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488059520 00010000:00010000:3.0:1789181514.955770:0:6707:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000059f46ab8/0x8f4f7840b2e41b25 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f232 expref: 9 pid: 6692 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181514.955819:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 62 00000100:00100000:3.0:1789181514.955829:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c071d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+9:2354:x1876092488059520:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789181514.955862:0:6707:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789181514.955882:0:6707:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1789181514.955885:0:6707:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1789181515 00002000:00010000:3.0:1789181514.955888:0:6707:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1789181515 00002000:00010000:3.0:1789181514.955891:0:6707:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1789181515 00010000:00010000:3.0:1789181514.955897:0:6707:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000059f46ab8/0x8f4f7840b2e41b25 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f232 expref: 9 pid: 6692 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181514.955912:0:6707:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000059f46ab8/0x8f4f7840b2e41b25 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f232 expref: 9 pid: 6692 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181514.955938:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059f46ab8/0x8f4f7840b2e41b25 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f232 expref: 9 pid: 6692 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181514.955955:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789181514.955959:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789181514.955965:0:6707:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002906dfa2/0x8f4f7840b2e41b72 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181514.955975:0:6707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002906dfa2/0x8f4f7840b2e41b72 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181514.956012:0:6707:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789181514.956073:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c071d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+8:2354:x1876092488059520:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 245us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181514.956081:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 62 00010000:00010000:0.0:1789181514.956190:0:6691:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002906dfa2/0x8f4f7840b2e41b72 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181514.956200:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002906dfa2/0x8f4f7840b2e41b72 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181514.956232:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002906dfa2/0x8f4f7840b2e41b72 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181514.956242:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002906dfa2/0x8f4f7840b2e41b72 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181514.956251:0:6691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002906dfa2/0x8f4f7840b2e41b72 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181514.956257:0:6691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1bfa1fa00 already unused, calling callback (ffffffffc152f9b0) 00010000:00010000:0.0:1789181514.956262:0:6691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002906dfa2/0x8f4f7840b2e41b72 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181514.956271:0:6691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002906dfa2/0x8f4f7840b2e41b72 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181514.956297:0:6691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002906dfa2/0x8f4f7840b2e41b72 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181514.956305:0:6691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002906dfa2/0x8f4f7840b2e41b72 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181514.956421:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c071df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+7:2354:x1876092488059264:12345-192.168.204.32@tcp:1:lfs.0 Request processed in 22866us (23036us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181514.956429:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 50 00000100:00100000:0.0:1789181514.959859:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181514.960210:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488059776 00000100:00100000:3.0:1789181514.960221:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488059776 00000100:00100000:3.0:1789181514.960281:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 38 00000100:00100000:3.0:1789181514.960291:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19928c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+25:11370:x1876092488059776:12345-192.168.204.32@tcp:35:lfs.0 00000004:00010000:3.0:1789181514.960684:0:5846:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890400/0x8f4f7840b2e41b64 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f24e expref: 25 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789181514.960956:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:3.0:1789181514.961004:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:3.0:1789181514.963608:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:3.0:1789181514.963702:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e41b79 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181514.963725:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258e00/0x8f4f7840b2e41b10 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f224 expref: 29 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181514.963735:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e41b79 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181514.963795:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258e00/0x8f4f7840b2e41b10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f224 expref: 29 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181514.963813:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258e00/0x8f4f7840b2e41b10 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f224 expref: 29 pid: 5843 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181514.963828:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1988c0700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5846:1876092510086144:192.168.204.32@tcp:104: 00000100:00100000:3.0:1789181514.963925:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1884b5480 going to sleep for 11 seconds 00000100:00100000:2.0:1789181514.967051:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1988c0700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5846:1876092510086144:192.168.204.32@tcp:104: 00010000:00010000:2.0:1789181514.967081:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e41b79 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181514.970042:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181514.970162:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488059904 00000100:00100000:3.0:1789181514.970171:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488059904 00010000:00010000:3.0:1789181514.970223:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258e00/0x8f4f7840b2e41b10 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f224 expref: 30 pid: 5843 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181514.970299:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 63 00000100:00100000:3.0:1789181514.970309:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c071c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+30:2354:x1876092488059904:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789181514.970373:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789181514.970381:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258e00/0x8f4f7840b2e41b10 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f224 expref: 30 pid: 5843 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181514.970396:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258e00/0x8f4f7840b2e41b10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f224 expref: 30 pid: 5843 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181514.970417:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258e00/0x8f4f7840b2e41b10 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f224 expref: 30 pid: 5843 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181514.970432:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9dc1995b7100) 00010000:00010000:3.0:1789181514.970438:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e41b79 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181514.970446:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e41b79 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181514.970454:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e41b79 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181514.970478:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789181514.970527:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c071c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+29:2354:x1876092488059904:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 220us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181514.970554:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 63 00010000:00010000:1.0:1789181514.970930:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e41b79 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181514.970940:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e41b79 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789181514.971065:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:1.0:1789181514.971270:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:1.0:1789181514.971421:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0833d0700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1876092510086272:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789181514.971477:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181514.971503:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc189bfd9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789181514.973904:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510086272 00000100:00100000:1.0:1789181514.973918:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510086272 00000100:00100000:1.0:1789181514.973993:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789181514.974004:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0833d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1876092510086272:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789181514.974132:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0833d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1876092510086272:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 129us (2653us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181514.974139:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789181514.974190:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc0833d0700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1876092510086272:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1789181514.976257:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:1.0:1789181514.976370:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0833d0700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1876092510086400:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789181514.976437:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181514.976467:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc189bfdd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789181514.976572:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510086400 00000100:00100000:2.0:1789181514.976588:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510086400 00000100:00100000:2.0:1789181514.976646:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789181514.976656:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0833d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1876092510086400:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789181514.976841:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0833d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5846:x1876092510086400:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 187us (403us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1789181514.976849:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789181514.980108:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc0833d0700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1876092510086400:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1789181514.980229:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:1.0:1789181514.980291:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e41b79 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181514.980303:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e41b79 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181514.980311:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e41b79 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181514.980317:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1bfa1fe00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:1.0:1789181514.980321:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e41b79 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181514.980363:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e41b79 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181514.980380:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9dc1995b7100) 00010000:00010000:1.0:1789181514.980384:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1789181514.980389:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e41b79 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181514.980395:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e41b79 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789181514.980646:0:5846:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789181514.980804:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:1.0:1789181514.980815:0:5846:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 407237483663ns, next at 408237481830ns, rc = 0 00000001:00080000:1.0:1789181514.980822:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:1.0:1789181514.980854:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9dc1995b7100) 00010000:00010000:1.0:1789181514.980858:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789181514.980865:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890400/0x8f4f7840b2e41b64 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f24e expref: 33 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181514.980999:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19928c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+32:11370:x1876092488059776:12345-192.168.204.32@tcp:35:lfs.0 Request processed in 20709us (21151us total) trans 4294967431 rc 0/0 00000100:00100000:1.0:1789181514.981008:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 38 00000020:00080000:1.0:1789181514.981014:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1789181514.983905:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181514.984007:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488060032 00000100:00100000:2.0:1789181514.984017:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488060032 00000100:00100000:2.0:1789181514.984075:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 147 00000100:00100000:2.0:1789181514.984086:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c071d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+32:11370:x1876092488060032:12345-192.168.204.32@tcp:101:lfs.0 00010000:00010000:2.0:1789181514.984110:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181514.984134:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258600/0x8f4f7840b2e41b80 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f255 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181514.984197:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258600/0x8f4f7840b2e41b80 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f255 expref: 33 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181514.984211:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258600/0x8f4f7840b2e41b80 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f255 expref: 33 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181514.984231:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9dc1995b7c00) 00010000:00010000:2.0:1789181514.984234:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789181514.984238:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1c0258600, rc 0) 00000100:00100000:2.0:1789181514.984304:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c071d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+33:11370:x1876092488060032:12345-192.168.204.32@tcp:101:lfs.0 Request processed in 219us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181514.984312:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 147 00000100:00100000:0.0:1789181514.988765:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181514.988837:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488060288 00000100:00100000:1.0:1789181514.988848:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488060288 00000100:00100000:1.0:1789181514.988907:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 39 00000100:00100000:1.0:1789181514.988918:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c071e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+33:11370:x1876092488060288:12345-192.168.204.32@tcp:35:lfs.0 00000100:00100000:1.0:1789181514.989175:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c071e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+34:11370:x1876092488060288:12345-192.168.204.32@tcp:35:lfs.0 Request processed in 259us (429us total) trans 4294967432 rc 0/0 00000100:00100000:1.0:1789181514.989183:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 39 00000100:00100000:3.0:1789181515.067961:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181515.068029:0:6887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488060544 00000100:00100000:0.0:1789181515.068042:0:6887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488060544 00000100:00100000:0.0:1789181515.068158:0:6887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 148 00000100:00100000:0.0:1789181515.068169:0:6887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1988c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+34:11380:x1876092488060544:12345-192.168.204.32@tcp:101:lfs.0 00010000:00010000:0.0:1789181515.068195:0:6887:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181515.068216:0:6887:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891a00/0x8f4f7840b2e41b87 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f25c expref: -99 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789181515.068311:0:6887:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1789181515.068482:0:6887:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891a00/0x8f4f7840b2e41b87 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f25c expref: 36 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181515.068519:0:6887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc18a6c2a00) 00010000:00010000:0.0:1789181515.068522:0:6887:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789181515.068528:0:6887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891a00/0x8f4f7840b2e41b87 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f25c expref: 36 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181515.068552:0:6887:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc189891a00, rc 0) 00000100:00100000:0.0:1789181515.068621:0:6887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1988c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+35:11380:x1876092488060544:12345-192.168.204.32@tcp:101:lfs.0 Request processed in 453us (670us total) trans 4294967433 rc 301/301 00000100:00100000:0.0:1789181515.068628:0:6887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 148 00000100:00100000:3.0:1789181515.073093:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181515.073571:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488060672 00000100:00100000:2.0:1789181515.073594:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488060672 00000100:00100000:2.0:1789181515.073726:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 149 00000100:00100000:2.0:1789181515.073738:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1988c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+35:11380:x1876092488060672:12345-192.168.204.32@tcp:34:lfs.0 00010000:00010000:2.0:1789181515.073888:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258000/0x8f4f7840b2e41b95 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181515.073906:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258000/0x8f4f7840b2e41b95 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181515.073985:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258000/0x8f4f7840b2e41b95 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181515.074002:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259600/0x8f4f7840b2e41b9c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181515.074009:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259600/0x8f4f7840b2e41b9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181515.074015:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259600/0x8f4f7840b2e41b9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181515.074474:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259200/0x8f4f7840b2e41ba3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181515.074484:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259200/0x8f4f7840b2e41ba3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181515.074491:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259200/0x8f4f7840b2e41ba3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789181515.074534:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259200/0x8f4f7840b2e41ba3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181515.074559:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258000/0x8f4f7840b2e41b95 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181515.074565:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258000/0x8f4f7840b2e41b95 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181515.074572:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258000/0x8f4f7840b2e41b95 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181515.074578:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1c0258000 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:2.0:1789181515.074582:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258000/0x8f4f7840b2e41b95 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181515.074589:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258000/0x8f4f7840b2e41b95 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181515.074602:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9dc1995b7800) 00010000:00010000:2.0:1789181515.074605:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789181515.074610:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258000/0x8f4f7840b2e41b95 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181515.074617:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258000/0x8f4f7840b2e41b95 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181515.074629:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259600/0x8f4f7840b2e41b9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181515.074635:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259600/0x8f4f7840b2e41b9c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181515.074712:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259600/0x8f4f7840b2e41b9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181515.074724:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1c0259600 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:2.0:1789181515.074727:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259600/0x8f4f7840b2e41b9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181515.074734:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259600/0x8f4f7840b2e41b9c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181515.074742:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9dc1995b7e00) 00010000:00010000:2.0:1789181515.074755:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789181515.074759:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259600/0x8f4f7840b2e41b9c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181515.074764:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259600/0x8f4f7840b2e41b9c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181515.074832:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259200/0x8f4f7840b2e41ba3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181515.074840:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259200/0x8f4f7840b2e41ba3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181515.074850:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259200/0x8f4f7840b2e41ba3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181515.074855:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1c0259200 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:2.0:1789181515.074858:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259200/0x8f4f7840b2e41ba3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181515.074863:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259200/0x8f4f7840b2e41ba3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181515.074881:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9dc1995b7c00) 00010000:00010000:2.0:1789181515.074883:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789181515.074886:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259200/0x8f4f7840b2e41ba3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181515.074891:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259200/0x8f4f7840b2e41ba3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181515.074975:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1988c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+35:11380:x1876092488060672:12345-192.168.204.32@tcp:34:lfs.0 Request processed in 1238us (1889us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181515.074984:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 149 00000100:00100000:3.0:1789181515.077990:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181515.078095:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488060928 00000100:00100000:1.0:1789181515.078104:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488060928 00000100:00100000:1.0:1789181515.078212:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 40 00000100:00100000:1.0:1789181515.078222:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1988c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+35:11380:x1876092488060928:12345-192.168.204.32@tcp:35:lfs.0 00000100:00100000:1.0:1789181515.078492:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1988c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+36:11380:x1876092488060928:12345-192.168.204.32@tcp:35:lfs.0 Request processed in 270us (510us total) trans 4294967434 rc 0/0 00000100:00100000:1.0:1789181515.078499:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 40 00000100:00100000:3.0:1789181515.116686:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181515.117256:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488061184 00000100:00100000:2.0:1789181515.117267:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488061184 00000100:00100000:2.0:1789181515.117373:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 150 00000100:00100000:2.0:1789181515.117385:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1988c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+36:11383:x1876092488061184:12345-192.168.204.32@tcp:101:lfs.0 00010000:00010000:2.0:1789181515.117408:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181515.117430:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259200/0x8f4f7840b2e41baa lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f263 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181515.117506:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259600/0x8f4f7840b2e41bb1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181515.117522:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259600/0x8f4f7840b2e41bb1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181515.119098:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259600/0x8f4f7840b2e41bb1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181515.119133:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258000/0x8f4f7840b2e41bb8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181515.119157:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258000/0x8f4f7840b2e41bb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181515.119166:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258000/0x8f4f7840b2e41bb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181515.119298:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259a00/0x8f4f7840b2e41bbf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181515.119307:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259a00/0x8f4f7840b2e41bbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181515.119315:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259a00/0x8f4f7840b2e41bbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789181515.119326:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789181515.119457:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259600/0x8f4f7840b2e41bb1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181515.119465:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259600/0x8f4f7840b2e41bb1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181515.119473:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259600/0x8f4f7840b2e41bb1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181515.119478:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1c0259600 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:2.0:1789181515.119482:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259600/0x8f4f7840b2e41bb1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181515.119489:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259600/0x8f4f7840b2e41bb1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181515.119512:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9dc1995b7800) 00010000:00010000:2.0:1789181515.119515:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789181515.119520:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259600/0x8f4f7840b2e41bb1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181515.119525:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259600/0x8f4f7840b2e41bb1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181515.122152:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258000/0x8f4f7840b2e41bb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181515.122163:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258000/0x8f4f7840b2e41bb8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181515.122171:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258000/0x8f4f7840b2e41bb8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181515.122177:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1c0258000 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:2.0:1789181515.122182:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258000/0x8f4f7840b2e41bb8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181515.122190:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258000/0x8f4f7840b2e41bb8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181515.122205:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9dc1995b7e00) 00010000:00010000:2.0:1789181515.122208:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789181515.122214:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258000/0x8f4f7840b2e41bb8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181515.122221:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258000/0x8f4f7840b2e41bb8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181515.122379:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259200/0x8f4f7840b2e41baa lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f263 expref: 39 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181515.122398:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259a00/0x8f4f7840b2e41bbf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f263 expref: 38 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181515.122406:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9dc1995b7c00) 00010000:00010000:2.0:1789181515.122409:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789181515.122411:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1c0259a00, rc 0) 00000100:00100000:2.0:1789181515.122489:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1988c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+38:11383:x1876092488061184:12345-192.168.204.32@tcp:101:lfs.0 Request processed in 5106us (5957us total) trans 4294967435 rc 0/0 00000100:00100000:2.0:1789181515.122498:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 150 00000100:00100000:3.0:1789181515.125888:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181515.126029:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488061312 00000100:00100000:0.0:1789181515.126040:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488061312 00000100:00100000:0.0:1789181515.126098:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 151 00000100:00100000:0.0:1789181515.126107:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c026e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+38:11383:x1876092488061312:12345-192.168.204.32@tcp:54:lfs.0 00010000:00010000:0.0:1789181515.126176:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891a00/0x8f4f7840b2e41bcd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181515.126193:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891a00/0x8f4f7840b2e41bcd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181515.126206:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891a00/0x8f4f7840b2e41bcd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181515.126231:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891a00/0x8f4f7840b2e41bcd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181515.126238:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891a00/0x8f4f7840b2e41bcd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181515.126263:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891a00/0x8f4f7840b2e41bcd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181515.126268:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc189891a00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:0.0:1789181515.126272:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891a00/0x8f4f7840b2e41bcd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181515.126280:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891a00/0x8f4f7840b2e41bcd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181515.126291:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9dc1995b7c00) 00010000:00010000:0.0:1789181515.126294:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789181515.126299:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891a00/0x8f4f7840b2e41bcd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181515.126305:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891a00/0x8f4f7840b2e41bcd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181515.126414:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c026e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+38:11383:x1876092488061312:12345-192.168.204.32@tcp:54:lfs.0 Request processed in 307us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181515.126421:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 151 00000100:00100000:1.0:1789181515.130470:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181515.130657:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488061568 00000100:00100000:2.0:1789181515.130683:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488061568 00000100:00100000:2.0:1789181515.130742:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 41 00000100:00100000:2.0:1789181515.130766:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0833d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+38:11383:x1876092488061568:12345-192.168.204.32@tcp:35:lfs.0 00000100:00100000:2.0:1789181515.131015:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0833d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+39:11383:x1876092488061568:12345-192.168.204.32@tcp:35:lfs.0 Request processed in 251us (553us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1789181515.131023:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 41 00010000:00010000:1.0:1789181515.326691:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789181515.382071:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967433 is committed 00000001:00080000:1.0:1789181515.382095:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967434 is committed 00000004:00080000:1.0:1789181515.382104:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:1.0:1789181515.382130:0:5865:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9dc189bfd480 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:1.0:1789181515.382136:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9dc1c0266800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9dc182488480 00000020:00080000:1.0:1789181515.382139:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9dc1c0266000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9dc18613a800 00000001:00080000:1.0:1789181515.382165:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967436 is committed 00000020:00080000:0.0:1789181515.382267:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000100:00100000:1.0:1789181515.383808:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c026fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876092510086528:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789181515.384010:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1789181515.384512:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1789181515.385098:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510086528 00000100:00100000:0.0:1789181515.385109:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510086528 00000100:00100000:0.0:1789181515.385180:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789181515.385192:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0833d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3306:x1876092510086528:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1789181515.385221:0:6693:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:0.0:1789181515.385255:0:6693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aa4be4b, atime: 0x6aa4be4b, ctime: 0x6aa4be4b, blocks: 0x1 00010000:00010000:0.0:1789181515.385273:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008301596c/0x8f4f7840b2e41bd4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181515.385291:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=407s v=(0 0) 00010000:00010000:0.0:1789181515.385296:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00000100:00080000:2.0:1789181515.386047:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789181515.387028:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008301596c/0x8f4f7840b2e41bd4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181515.387046:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008301596c/0x8f4f7840b2e41bd4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181515.387056:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008301596c/0x8f4f7840b2e41bd4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181515.387063:0:6693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008301596c/0x8f4f7840b2e41bd4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181515.391715:0:6693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789181515.391869:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789181515.391887:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008301596c/0x8f4f7840b2e41bd4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181515.391901:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc189891a00 already unused, calling callback (ffffffffc152f9b0) 00010000:00010000:2.0:1789181515.391919:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008301596c/0x8f4f7840b2e41bd4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181515.391930:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008301596c/0x8f4f7840b2e41bd4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181515.391953:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008301596c/0x8f4f7840b2e41bd4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181515.391961:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008301596c/0x8f4f7840b2e41bd4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181515.391988:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181515.391990:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181515.391992:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181515.395084:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0833d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3306:x1876092510086528:12345-0@lo:6:osp-syn-0-0.0 Request processed in 9885us (11064us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1789181515.395101:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000004:00080000:2.0:1789181515.395352:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9dc1c026fb80/2, rc 0, transno 4294967307 00000100:00100000:2.0:1789181515.395359:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c026fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876092510086528:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789181515.539903:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181515.540379:0:6887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488061824 00000100:00100000:0.0:1789181515.540390:0:6887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488061824 00000100:00100000:0.0:1789181515.540456:0:6887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 152 00000100:00100000:0.0:1789181515.540467:0:6887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b66f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+17:11415:x1876092488061824:12345-192.168.204.32@tcp:101:cat.0 00010000:00010000:0.0:1789181515.540490:0:6887:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181515.540510:0:6887:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891a00/0x8f4f7840b2e41bdb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f26a expref: -99 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181515.540606:0:6887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891800/0x8f4f7840b2e41be2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181515.540638:0:6887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891800/0x8f4f7840b2e41be2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181515.540651:0:6887:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891800/0x8f4f7840b2e41be2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789181515.540662:0:6887:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1789181515.541070:0:6887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891a00/0x8f4f7840b2e41bdb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f26a expref: 20 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181515.541089:0:6887:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891800/0x8f4f7840b2e41be2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f26a expref: 19 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181515.541097:0:6887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9dc1995b7c00) 00010000:00010000:0.0:1789181515.541101:0:6887:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789181515.541104:0:6887:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc189891800, rc 0) 00000100:00100000:0.0:1789181515.541170:0:6887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b66f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+19:11415:x1876092488061824:12345-192.168.204.32@tcp:101:cat.0 Request processed in 704us (1277us total) trans 4294967437 rc 0/0 00000100:00100000:0.0:1789181515.541178:0:6887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 152 00000100:00100000:3.0:1789181515.544403:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181515.544496:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488062080 00000100:00100000:2.0:1789181515.544507:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488062080 00000100:00100000:2.0:1789181515.544570:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 42 00000100:00100000:2.0:1789181515.544582:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b66f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+19:11415:x1876092488062080:12345-192.168.204.32@tcp:35:cat.0 00000100:00100000:2.0:1789181515.544847:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b66f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+20:11415:x1876092488062080:12345-192.168.204.32@tcp:35:cat.0 Request processed in 267us (453us total) trans 4294967438 rc 0/0 00000100:00100000:2.0:1789181515.544855:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 42 00000100:00100000:1.0:1789181515.547602:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181515.547686:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488062208 00000100:00100000:3.0:1789181515.547696:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488062208 00000100:00100000:3.0:1789181515.547789:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 12 00000100:00100000:3.0:1789181515.547800:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19619f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+20:2351:x1876092488062208:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789181515.547816:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789181515.547838:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891800/0x8f4f7840b2e41be2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f26a expref: 20 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181515.547856:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9dc1995b7c00) 00010000:00010000:3.0:1789181515.547862:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789181515.547926:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19619f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+19:2351:x1876092488062208:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 128us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181515.547934:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 12 00000100:00100000:3.0:1789181515.627088:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181515.627889:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488062464 00000100:00100000:0.0:1789181515.627901:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488062464 00000100:00100000:0.0:1789181515.628011:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 153 00000100:00100000:0.0:1789181515.628023:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b66f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+19:11421:x1876092488062464:12345-192.168.204.32@tcp:101:dd.0 00010000:00010000:0.0:1789181515.628047:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181515.628050:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789181515.628075:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258c00/0x8f4f7840b2e41b41 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f240 expref: 19 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181515.628112:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9dc1995b7800) 00010000:00010000:0.0:1789181515.628117:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789181515.628133:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891a00/0x8f4f7840b2e41bf0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f271 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181515.628230:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890400/0x8f4f7840b2e41bf7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181515.628243:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259a00/0x8f4f7840b2e41bbf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f263 expref: 19 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181515.628251:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890400/0x8f4f7840b2e41bf7 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181515.628282:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259a00/0x8f4f7840b2e41bbf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f263 expref: 19 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181515.628307:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259a00/0x8f4f7840b2e41bbf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f263 expref: 19 pid: 5842 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181515.628321:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c071f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1876092510086656:192.168.204.32@tcp:104: 00000100:00100000:0.0:1789181515.628454:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc188bfd6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789181515.632718:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181515.632827:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c071f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1876092510086656:192.168.204.32@tcp:104: 00010000:00010000:0.0:1789181515.632860:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890400/0x8f4f7840b2e41bf7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181515.632978:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488062592 00000100:00100000:2.0:1789181515.632985:0:8456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488062592 00010000:00010000:2.0:1789181515.633021:0:8456:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259a00/0x8f4f7840b2e41bbf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f263 expref: 20 pid: 5842 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181515.633076:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 64 00000100:00100000:2.0:1789181515.633085:0:8456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0833d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5971a429-48ca-4c07-88a3-fa58102a53bc+20:2354:x1876092488062592:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789181515.633102:0:8456:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789181515.633241:0:8456:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259a00/0x8f4f7840b2e41bbf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f263 expref: 20 pid: 5842 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181515.633253:0:8456:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259a00/0x8f4f7840b2e41bbf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f263 expref: 20 pid: 5842 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181515.633274:0:8456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259a00/0x8f4f7840b2e41bbf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f263 expref: 20 pid: 5842 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181515.633289:0:8456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9dc1995b7c00) 00010000:00010000:2.0:1789181515.633293:0:8456:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890400/0x8f4f7840b2e41bf7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181515.633302:0:8456:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890400/0x8f4f7840b2e41bf7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181515.633310:0:8456:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890400/0x8f4f7840b2e41bf7 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181515.633409:0:8456:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789181515.633463:0:8456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0833d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5971a429-48ca-4c07-88a3-fa58102a53bc+19:2354:x1876092488062592:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 378us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181515.633471:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 64 00010000:00010000:0.0:1789181515.634514:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890400/0x8f4f7840b2e41bf7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181515.634540:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890400/0x8f4f7840b2e41bf7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789181515.634559:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1789181515.634717:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891a00/0x8f4f7840b2e41bf0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f271 expref: 20 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181515.634745:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890400/0x8f4f7840b2e41bf7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f271 expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181515.634754:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9dc1995b7c00) 00010000:00010000:0.0:1789181515.634757:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789181515.634760:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc189890400, rc 0) 00000100:00100000:0.0:1789181515.634911:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b66f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+19:11421:x1876092488062464:12345-192.168.204.32@tcp:101:dd.0 Request processed in 6890us (7832us total) trans 4294967439 rc 0/0 00000100:00100000:0.0:1789181515.634919:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 153 00000100:00100000:1.0:1789181515.637004:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181515.637076:0:6887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488062848 00000100:00100000:0.0:1789181515.637086:0:6887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488062848 00000100:00100000:0.0:1789181515.637163:0:6887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 154 00000100:00100000:0.0:1789181515.637173:0:6887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0833d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+19:11421:x1876092488062848:12345-192.168.204.32@tcp:36:dd.0 00010000:00010000:0.0:1789181515.637512:0:6887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890c00/0x8f4f7840b2e41c05 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181515.637528:0:6887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890c00/0x8f4f7840b2e41c05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181515.637539:0:6887:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890c00/0x8f4f7840b2e41c05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789181515.637625:0:6887:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:0.0:1789181515.637648:0:6887:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d31774bb reply state 000000006425e867 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890c00/0x8f4f7840b2e41c05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181515.637657:0:6887:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789181515.637756:0:6887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0833d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+22:11421:x1876092488062848:12345-192.168.204.32@tcp:36:dd.0 Request processed in 584us (760us total) trans 4294967441 rc 0/0 00000100:00100000:0.0:1789181515.637764:0:6887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 154 00000020:00080000:0.0:1789181515.637770:0:6887:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789181515.639910:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890c00/0x8f4f7840b2e41c05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181515.639928:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890c00/0x8f4f7840b2e41c05 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181515.639936:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890c00/0x8f4f7840b2e41c05 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181515.639942:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc189890c00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:1.0:1789181515.639947:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890c00/0x8f4f7840b2e41c05 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181515.639955:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890c00/0x8f4f7840b2e41c05 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181515.639971:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9dc1995b7c00) 00010000:00010000:1.0:1789181515.639974:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789181515.639979:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890c00/0x8f4f7840b2e41c05 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181515.639985:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890c00/0x8f4f7840b2e41c05 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181515.774882:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1ba4a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876092510086912:0@lo:400:kworker.0 00000100:00100000:2.0:1789181515.774959:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181515.775018:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfa2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876092510087424:0@lo:400:kworker.0 00000100:00100000:2.0:1789181515.775042:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181515.775074:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789181515.775080:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1ba4a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:880710ad-110c-42a4-a174-ab1b99a7ebeb:3304:1876092510086784:0@lo:400:kworker.0 00000100:00100000:2.0:1789181515.775109:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181515.775130:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfa2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1876092510087296:0@lo:400:kworker.0 00000100:00100000:2.0:1789181515.775166:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181515.775201:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1ba4aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1876092510087040:0@lo:400:kworker.0 00000100:00100000:2.0:1789181515.775224:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181515.775243:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789181515.775249:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfa2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510087168:0@lo:400:kworker.0 00000100:00100000:2.0:1789181515.775268:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181515.775299:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510087424 00000100:00100000:2.0:1789181515.775307:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510087424 00000100:00100000:2.0:1789181515.775377:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510087168 00000100:00100000:2.0:1789181515.775381:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510087168 00000100:00100000:2.0:1789181515.775401:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789181515.775410:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfa2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876092510087424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181515.775461:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfa2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876092510087424:12345-0@lo:400:kworker.0 Request processed in 52us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181515.775467:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789181515.775483:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789181515.775489:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c01b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3305:x1876092510087168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181515.775519:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c01b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3305:x1876092510087168:12345-0@lo:400:kworker.0 Request processed in 31us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181515.775533:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789181515.775553:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510086784 00000100:00100000:2.0:1789181515.775556:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510086784 00000100:00100000:2.0:1789181515.775580:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1789181515.775587:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c272c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:3304:x1876092510086784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181515.775617:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c272c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:3304:x1876092510086784:12345-0@lo:400:kworker.0 Request processed in 31us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181515.775624:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00080000:2.0:1789181515.775652:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789181515.775684:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfa2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510087168:0@lo:400:kworker.0 00000100:00100000:2.0:1789181515.775710:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1ba4a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:880710ad-110c-42a4-a174-ab1b99a7ebeb:3304:1876092510086784:0@lo:400:kworker.0 00000100:00100000:2.0:1789181515.775718:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfa2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876092510087424:0@lo:400:kworker.0 00000100:00100000:2.0:1789181515.775748:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510086912 00000100:00100000:2.0:1789181515.775752:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510086912 00000100:00100000:2.0:1789181515.775776:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510087296 00000100:00100000:2.0:1789181515.775779:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510087296 00000100:00100000:2.0:1789181515.775793:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510087040 00000100:00100000:2.0:1789181515.775796:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510087040 00000100:00100000:2.0:1789181515.775807:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789181515.775812:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfa2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876092510086912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181515.775845:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfa2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876092510086912:12345-0@lo:400:kworker.0 Request processed in 33us (887us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181515.775850:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789181515.775860:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789181515.775866:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c01b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876092510087296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181515.775901:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c01b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876092510087296:12345-0@lo:400:kworker.0 Request processed in 35us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181515.775907:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789181515.775919:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789181515.775924:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c01b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876092510087040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181515.775954:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c01b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876092510087040:12345-0@lo:400:kworker.0 Request processed in 30us (729us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181515.775959:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:2.0:1789181515.775973:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789181515.775992:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1ba4aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1876092510087040:0@lo:400:kworker.0 00000100:00100000:2.0:1789181515.776013:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfa2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1876092510087296:0@lo:400:kworker.0 00000100:00100000:2.0:1789181515.776022:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1ba4a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876092510086912:0@lo:400:kworker.0 00000100:00100000:1.0:1789181515.844311:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181515.844426:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488062976 00000100:00100000:2.0:1789181515.844435:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488062976 00000100:00100000:2.0:1789181515.844496:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 155 00000100:00100000:2.0:1789181515.844506:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0833d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+21:11435:x1876092488062976:12345-192.168.204.32@tcp:101:stat.0 00010000:00010000:2.0:1789181515.844529:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181515.844551:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259a00/0x8f4f7840b2e41c0c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f278 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181515.844618:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259200/0x8f4f7840b2e41c13 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181515.844632:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259200/0x8f4f7840b2e41c13 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181515.844668:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259200/0x8f4f7840b2e41c13 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181515.844682:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258000/0x8f4f7840b2e41c1a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181515.844704:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258000/0x8f4f7840b2e41c1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181515.844711:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258000/0x8f4f7840b2e41c1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181515.845001:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259600/0x8f4f7840b2e41c21 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181515.845014:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890400/0x8f4f7840b2e41bf7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f271 expref: 22 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181515.845022:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259600/0x8f4f7840b2e41c21 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181515.845055:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890400/0x8f4f7840b2e41bf7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f271 expref: 22 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181515.845070:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890400/0x8f4f7840b2e41bf7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f271 expref: 22 pid: 5844 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181515.845084:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c01b0380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1876092510087552:192.168.204.32@tcp:104: 00000100:00100000:2.0:1789181515.845167:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc18872a000 going to sleep for 11 seconds 00000100:00100000:3.0:1789181515.849622:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181515.849744:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488063232 00000100:00100000:1.0:1789181515.849756:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488063232 00000100:00100000:1.0:1789181515.849829:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 43 00000100:00100000:1.0:1789181515.849841:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b66f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+23:5591:x1876092488063232:12345-192.168.204.32@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789181515.850180:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b66f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+24:5591:x1876092488063232:12345-192.168.204.32@tcp:35:ldlm_bl.0 Request processed in 341us (568us total) trans 4294967442 rc 0/0 00000100:00100000:1.0:1789181515.850187:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 43 00000100:00100000:2.0:1789181515.852704:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c01b0380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1876092510087552:192.168.204.32@tcp:104: 00010000:00010000:2.0:1789181515.852745:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259600/0x8f4f7840b2e41c21 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181515.853505:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181515.853651:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488063360 00000100:00100000:2.0:1789181515.853660:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488063360 00010000:00010000:2.0:1789181515.853709:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890400/0x8f4f7840b2e41bf7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f271 expref: 24 pid: 5844 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181515.853756:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 65 00000100:00100000:2.0:1789181515.853766:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1988c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+24:2352:x1876092488063360:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789181515.853789:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789181515.853797:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890400/0x8f4f7840b2e41bf7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f271 expref: 24 pid: 5844 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181515.853809:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890400/0x8f4f7840b2e41bf7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f271 expref: 24 pid: 5844 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181515.853830:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890400/0x8f4f7840b2e41bf7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f271 expref: 24 pid: 5844 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181515.853846:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9dc1995b7c00) 00010000:00010000:2.0:1789181515.853851:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259600/0x8f4f7840b2e41c21 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181515.853860:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259600/0x8f4f7840b2e41c21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181515.853868:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259600/0x8f4f7840b2e41c21 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181515.853913:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789181515.853966:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1988c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+23:2352:x1876092488063360:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 201us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181515.853974:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 65 00010000:00010000:0.0:1789181515.855190:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259600/0x8f4f7840b2e41c21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181515.855204:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259600/0x8f4f7840b2e41c21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789181515.855250:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1789181515.855254:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789181515.855280:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259600/0x8f4f7840b2e41c21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181515.855295:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259600/0x8f4f7840b2e41c21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181515.855304:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259200/0x8f4f7840b2e41c13 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181515.855311:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259200/0x8f4f7840b2e41c13 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181515.855317:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259200/0x8f4f7840b2e41c13 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181515.855357:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1c0259200 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:0.0:1789181515.855361:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259200/0x8f4f7840b2e41c13 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181515.855369:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259200/0x8f4f7840b2e41c13 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181515.855383:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9dc1995b7800) 00010000:00010000:0.0:1789181515.855386:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789181515.855390:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259200/0x8f4f7840b2e41c13 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181515.855397:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259200/0x8f4f7840b2e41c13 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181515.855412:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258000/0x8f4f7840b2e41c1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181515.855417:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258000/0x8f4f7840b2e41c1a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181515.855423:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258000/0x8f4f7840b2e41c1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181515.855428:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1c0258000 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:0.0:1789181515.855431:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258000/0x8f4f7840b2e41c1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181515.855437:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258000/0x8f4f7840b2e41c1a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181515.855471:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9dc1995b7500) 00010000:00010000:0.0:1789181515.855474:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789181515.855477:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258000/0x8f4f7840b2e41c1a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181515.855482:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258000/0x8f4f7840b2e41c1a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181515.855523:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259a00/0x8f4f7840b2e41c0c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f278 expref: 23 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181515.855536:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259600/0x8f4f7840b2e41c21 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f278 expref: 22 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181515.855542:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9dc1995b7c00) 00010000:00010000:0.0:1789181515.855545:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789181515.855547:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1c0259600, rc 0) 00000100:00100000:0.0:1789181515.855609:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0833d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+22:11435:x1876092488062976:12345-192.168.204.32@tcp:101:stat.0 Request processed in 11105us (11309us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181515.855617:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 155 00000100:00100000:3.0:1789181515.950522:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181515.950688:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488063616 00000100:00100000:2.0:1789181515.950699:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488063616 00000100:00100000:2.0:1789181515.950769:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 156 00000100:00100000:2.0:1789181515.950780:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1988c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+22:11441:x1876092488063616:12345-192.168.204.32@tcp:36:truncate.0 00010000:00010000:2.0:1789181515.950848:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789181515.950876:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259600/0x8f4f7840b2e41c21 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f278 expref: 22 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181515.950897:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9dc1995b7c00) 00010000:00010000:2.0:1789181515.950902:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789181515.951113:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259800/0x8f4f7840b2e41c28 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181515.951127:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259800/0x8f4f7840b2e41c28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181515.951137:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259800/0x8f4f7840b2e41c28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789181515.951191:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:2.0:1789181515.951215:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006dce241a reply state 00000000b2744ad7 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259800/0x8f4f7840b2e41c28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181515.951225:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789181515.951383:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1988c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+24:11441:x1876092488063616:12345-192.168.204.32@tcp:36:truncate.0 Request processed in 603us (869us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1789181515.951391:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 156 00000020:00080000:2.0:1789181515.951396:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789181515.954250:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259800/0x8f4f7840b2e41c28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181515.954267:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259800/0x8f4f7840b2e41c28 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181515.954275:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259800/0x8f4f7840b2e41c28 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181515.954282:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1c0259800 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:1.0:1789181515.954286:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259800/0x8f4f7840b2e41c28 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181515.954294:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259800/0x8f4f7840b2e41c28 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181515.954309:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9dc1995b7c00) 00010000:00010000:1.0:1789181515.954313:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789181515.954318:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259800/0x8f4f7840b2e41c28 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181515.954324:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259800/0x8f4f7840b2e41c28 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181516.107303:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181516.107636:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488063744 00000100:00100000:0.0:1789181516.107647:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488063744 00000100:00100000:0.0:1789181516.107793:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 157 00000100:00100000:0.0:1789181516.107805:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+23:11455:x1876092488063744:12345-192.168.204.32@tcp:101:stat.0 00010000:00010000:0.0:1789181516.107830:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181516.107861:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891a00/0x8f4f7840b2e41c2f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f27f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181516.108140:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891000/0x8f4f7840b2e41c36 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181516.108155:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891000/0x8f4f7840b2e41c36 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181516.108167:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891000/0x8f4f7840b2e41c36 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181516.108181:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891c00/0x8f4f7840b2e41c3d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181516.108188:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891c00/0x8f4f7840b2e41c3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181516.108194:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891c00/0x8f4f7840b2e41c3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181516.108514:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890600/0x8f4f7840b2e41c44 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181516.108524:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890600/0x8f4f7840b2e41c44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181516.108532:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890600/0x8f4f7840b2e41c44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789181516.108571:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1789181516.108575:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789181516.108594:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890600/0x8f4f7840b2e41c44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181516.108615:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890600/0x8f4f7840b2e41c44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181516.108622:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891000/0x8f4f7840b2e41c36 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181516.108629:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891000/0x8f4f7840b2e41c36 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181516.108636:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891000/0x8f4f7840b2e41c36 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181516.108641:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc189891000 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:0.0:1789181516.108646:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891000/0x8f4f7840b2e41c36 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181516.108653:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891000/0x8f4f7840b2e41c36 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181516.108665:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9dc1995b7800) 00010000:00010000:0.0:1789181516.108669:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789181516.108674:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891000/0x8f4f7840b2e41c36 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181516.108681:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891000/0x8f4f7840b2e41c36 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181516.108806:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891c00/0x8f4f7840b2e41c3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181516.108814:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891c00/0x8f4f7840b2e41c3d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181516.108826:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891c00/0x8f4f7840b2e41c3d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181516.108831:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc189891c00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:0.0:1789181516.109095:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891c00/0x8f4f7840b2e41c3d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181516.109103:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891c00/0x8f4f7840b2e41c3d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181516.109113:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9dc18553a000) 00010000:00010000:0.0:1789181516.109115:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789181516.109119:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891c00/0x8f4f7840b2e41c3d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181516.109125:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891c00/0x8f4f7840b2e41c3d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181516.109162:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891a00/0x8f4f7840b2e41c2f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f27f expref: 25 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181516.109176:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890600/0x8f4f7840b2e41c44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f27f expref: 24 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181516.109184:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9dc1995b7c00) 00010000:00010000:0.0:1789181516.109187:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789181516.109189:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc189890600, rc 0) 00000100:00100000:0.0:1789181516.109260:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+24:11455:x1876092488063744:12345-192.168.204.32@tcp:101:stat.0 Request processed in 1458us (1968us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181516.109277:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 157 00000100:00080000:2.0:1789181516.109496:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789181516.207907:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181516.208084:0:6887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488064000 00000100:00100000:0.0:1789181516.208097:0:6887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488064000 00000100:00100000:0.0:1789181516.208179:0:6887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 158 00000100:00100000:0.0:1789181516.208201:0:6887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+24:11465:x1876092488064000:12345-192.168.204.32@tcp:101:lfs.0 00010000:00010000:0.0:1789181516.208224:0:6887:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181516.208244:0:6887:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891a00/0x8f4f7840b2e41c4b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f286 expref: -99 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789181516.208362:0:6887:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1789181516.208497:0:6887:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891a00/0x8f4f7840b2e41c4b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f286 expref: 26 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181516.208512:0:6887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc18a6c2a00) 00010000:00010000:0.0:1789181516.208515:0:6887:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789181516.208520:0:6887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891a00/0x8f4f7840b2e41c4b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f286 expref: 26 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181516.208533:0:6887:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc189891a00, rc 0) 00000100:00100000:0.0:1789181516.208592:0:6887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+25:11465:x1876092488064000:12345-192.168.204.32@tcp:101:lfs.0 Request processed in 403us (696us total) trans 4294967445 rc 301/301 00000100:00100000:0.0:1789181516.208599:0:6887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 158 00000100:00100000:3.0:1789181516.214406:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181516.215263:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488064256 00000100:00100000:0.0:1789181516.215276:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488064256 00000100:00100000:0.0:1789181516.215447:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 44 00000100:00100000:0.0:1789181516.215458:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19928e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+25:11465:x1876092488064256:12345-192.168.204.32@tcp:35:lfs.0 00000100:00100000:0.0:1789181516.215735:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19928e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+26:11465:x1876092488064256:12345-192.168.204.32@tcp:35:lfs.0 Request processed in 268us (1402us total) trans 4294967446 rc 0/0 00000100:00100000:0.0:1789181516.215745:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 44 00000100:00100000:2.0:1789181516.286643:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfb45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510087680:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789181516.286719:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181516.287071:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510087680 00000100:00100000:3.0:1789181516.287081:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510087680 00000100:00100000:3.0:1789181516.287225:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789181516.287236:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c01b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510087680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789181516.287273:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789181516.287352:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c01b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510087680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181516.287360:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789181516.287435:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfb45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510087680:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789181516.289763:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181516.290000:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488064512 00000100:00100000:1.0:1789181516.290008:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488064512 00000100:00100000:1.0:1789181516.290129:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 159 00000100:00100000:1.0:1789181516.290142:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+26:11471:x1876092488064512:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:1.0:1789181516.290184:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181516.290207:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b600/0x8f4f7840b2e41c59 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f28d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181516.290327:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e41c60 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181516.290370:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890600/0x8f4f7840b2e41c44 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f27f expref: 27 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181516.290378:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e41c60 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181516.290416:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890600/0x8f4f7840b2e41c44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f27f expref: 27 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181516.290430:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890600/0x8f4f7840b2e41c44 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f27f expref: 27 pid: 5842 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181516.290445:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0833d3800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1876092510087808:192.168.204.32@tcp:104: 00000100:00100000:1.0:1789181516.290531:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc189899f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789181516.292565:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc0833d3800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1876092510087808:192.168.204.32@tcp:104: 00010000:00010000:1.0:1789181516.292593:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e41c60 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181516.293114:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181516.293367:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488064640 00000100:00100000:0.0:1789181516.293375:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488064640 00010000:00010000:0.0:1789181516.293412:0:6707:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890600/0x8f4f7840b2e41c44 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f27f expref: 28 pid: 5842 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181516.293504:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 66 00000100:00100000:0.0:1789181516.293514:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1baba6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+28:2353:x1876092488064640:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789181516.293528:0:6707:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789181516.293535:0:6707:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890600/0x8f4f7840b2e41c44 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f27f expref: 28 pid: 5842 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181516.293547:0:6707:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890600/0x8f4f7840b2e41c44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f27f expref: 28 pid: 5842 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181516.293569:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890600/0x8f4f7840b2e41c44 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f27f expref: 28 pid: 5842 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181516.293585:0:6707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9dc1995b7c00) 00010000:00010000:0.0:1789181516.293590:0:6707:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e41c60 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181516.293600:0:6707:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e41c60 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181516.293609:0:6707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e41c60 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181516.293656:0:6707:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789181516.293710:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1baba6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+27:2353:x1876092488064640:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 198us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181516.293718:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 66 00010000:00010000:1.0:1789181516.293792:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e41c60 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181516.293799:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e41c60 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789181516.293824:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:1.0:1789181516.294071:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b600/0x8f4f7840b2e41c59 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f28d expref: 28 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181516.294092:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e41c60 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f28d expref: 27 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181516.294098:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9dc1995b7c00) 00010000:00010000:1.0:1789181516.294101:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789181516.294103:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc18151ae00, rc 0) 00000100:00100000:1.0:1789181516.294130:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+27:11471:x1876092488064512:12345-192.168.204.32@tcp:101:bash.0 Request processed in 3993us (4376us total) trans 4294967447 rc 0/0 00000100:00100000:1.0:1789181516.294136:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 159 00000100:00100000:3.0:1789181516.297737:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181516.297940:0:6887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488064896 00000100:00100000:0.0:1789181516.297950:0:6887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488064896 00000100:00100000:0.0:1789181516.298010:0:6887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 160 00000100:00100000:0.0:1789181516.298022:0:6887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1baba5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+27:11471:x1876092488064896:12345-192.168.204.32@tcp:36:bash.0 00010000:00010000:0.0:1789181516.298308:0:6887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891a00/0x8f4f7840b2e41c6e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181516.298327:0:6887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891a00/0x8f4f7840b2e41c6e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181516.298361:0:6887:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891a00/0x8f4f7840b2e41c6e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789181516.298420:0:6887:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:0.0:1789181516.298446:0:6887:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000058f71968 reply state 000000005aa9d01f transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891a00/0x8f4f7840b2e41c6e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181516.298456:0:6887:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789181516.298596:0:6887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1baba5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+30:11471:x1876092488064896:12345-192.168.204.32@tcp:36:bash.0 Request processed in 575us (879us total) trans 4294967449 rc 0/0 00000100:00100000:0.0:1789181516.298604:0:6887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 160 00000020:00080000:0.0:1789181516.298609:0:6887:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789181516.302212:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891a00/0x8f4f7840b2e41c6e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181516.302231:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891a00/0x8f4f7840b2e41c6e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181516.302240:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891a00/0x8f4f7840b2e41c6e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181516.302247:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc189891a00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:1.0:1789181516.302252:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891a00/0x8f4f7840b2e41c6e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181516.302261:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891a00/0x8f4f7840b2e41c6e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181516.305493:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9dc1995b7c00) 00010000:00010000:1.0:1789181516.305497:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789181516.305505:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891a00/0x8f4f7840b2e41c6e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181516.305514:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891a00/0x8f4f7840b2e41c6e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181516.305632:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181516.305700:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488065024 00000100:00100000:0.0:1789181516.305710:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488065024 00000100:00100000:0.0:1789181516.305777:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 161 00000100:00100000:0.0:1789181516.305800:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1baba7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+29:11471:x1876092488065024:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:0.0:1789181516.305822:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181516.305850:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891c00/0x8f4f7840b2e41c75 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f294 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181516.305947:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891000/0x8f4f7840b2e41c7c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181516.305962:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e41c60 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f28d expref: 30 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181516.305971:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891000/0x8f4f7840b2e41c7c lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181516.306006:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e41c60 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f28d expref: 30 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181516.306019:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e41c60 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f28d expref: 30 pid: 5843 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181516.306032:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c071e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1876092510087936:192.168.204.32@tcp:104: 00000100:00100000:0.0:1789181516.306123:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc188bfd840 going to sleep for 11 seconds 00000100:00100000:3.0:1789181516.313758:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181516.313876:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c071e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1876092510087936:192.168.204.32@tcp:104: 00010000:00010000:0.0:1789181516.313916:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891000/0x8f4f7840b2e41c7c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181516.314294:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488065152 00000100:00100000:1.0:1789181516.314304:0:8456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488065152 00010000:00010000:1.0:1789181516.314361:0:8456:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e41c60 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f28d expref: 31 pid: 5843 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181516.314403:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 67 00000100:00100000:1.0:1789181516.314413:0:8456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1baba4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5971a429-48ca-4c07-88a3-fa58102a53bc+31:2353:x1876092488065152:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789181516.314429:0:8456:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789181516.314436:0:8456:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e41c60 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f28d expref: 31 pid: 5843 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181516.314448:0:8456:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e41c60 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f28d expref: 31 pid: 5843 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181516.314470:0:8456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e41c60 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f28d expref: 31 pid: 5843 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181516.314492:0:8456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9dc1995b7c00) 00010000:00010000:1.0:1789181516.314497:0:8456:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891000/0x8f4f7840b2e41c7c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181516.314520:0:8456:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891000/0x8f4f7840b2e41c7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181516.314527:0:8456:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891000/0x8f4f7840b2e41c7c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181516.314549:0:8456:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789181516.314609:0:8456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1baba4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5971a429-48ca-4c07-88a3-fa58102a53bc+30:2353:x1876092488065152:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 198us (867us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181516.314617:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 67 00010000:00010000:0.0:1789181516.314850:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891000/0x8f4f7840b2e41c7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181516.314878:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891000/0x8f4f7840b2e41c7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789181516.314922:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1789181516.314926:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789181516.314946:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891000/0x8f4f7840b2e41c7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181516.314976:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891c00/0x8f4f7840b2e41c75 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f294 expref: 30 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181516.314991:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891000/0x8f4f7840b2e41c7c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f294 expref: 29 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181516.315000:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9dc1995b7c00) 00010000:00010000:0.0:1789181516.315003:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789181516.315006:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc189891000, rc 0) 00000100:00100000:0.0:1789181516.315048:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1baba7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+29:11471:x1876092488065024:12345-192.168.204.32@tcp:101:bash.0 Request processed in 9251us (9420us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181516.315055:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 161 00000100:00100000:3.0:1789181516.319054:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181516.319147:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488065408 00000100:00100000:1.0:1789181516.319158:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488065408 00000100:00100000:1.0:1789181516.319216:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 45 00000100:00100000:1.0:1789181516.319227:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1baba5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+29:11471:x1876092488065408:12345-192.168.204.32@tcp:35:bash.0 00000100:00100000:1.0:1789181516.319514:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1baba5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+30:11471:x1876092488065408:12345-192.168.204.32@tcp:35:bash.0 Request processed in 289us (469us total) trans 4294967450 rc 0/0 00000100:00100000:1.0:1789181516.319522:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 45 00010000:00010000:1.0:1789181516.350614:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789181516.415139:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181516.415261:0:6887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488065664 00000100:00100000:0.0:1789181516.415272:0:6887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488065664 00000100:00100000:0.0:1789181516.415365:0:6887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 162 00000100:00100000:0.0:1789181516.415377:0:6887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1baba5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+30:11481:x1876092488065664:12345-192.168.204.32@tcp:101:lfs.0 00010000:00010000:0.0:1789181516.415405:0:6887:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181516.415438:0:6887:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891c00/0x8f4f7840b2e41c83 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f29b expref: -99 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789181516.415546:0:6887:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1789181516.415678:0:6887:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891c00/0x8f4f7840b2e41c83 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f29b expref: 32 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181516.415692:0:6887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc18a6c2a00) 00010000:00010000:0.0:1789181516.415695:0:6887:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789181516.415701:0:6887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891c00/0x8f4f7840b2e41c83 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f29b expref: 32 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181516.415715:0:6887:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc189891c00, rc 0) 00000100:00100000:0.0:1789181516.415790:0:6887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1baba5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+31:11481:x1876092488065664:12345-192.168.204.32@tcp:101:lfs.0 Request processed in 416us (661us total) trans 4294967451 rc 301/301 00000100:00100000:0.0:1789181516.415798:0:6887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 162 00000100:00100000:3.0:1789181516.430081:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181516.433952:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488065792 00000100:00100000:1.0:1789181516.433966:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488065792 00000100:00100000:1.0:1789181516.434049:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 163 00000100:00100000:1.0:1789181516.434062:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1baba5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+31:11481:x1876092488065792:12345-192.168.204.32@tcp:34:lfs.0 00010000:00010000:1.0:1789181516.434373:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e41c91 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181516.434393:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e41c91 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181516.434425:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e41c91 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181516.434442:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b600/0x8f4f7840b2e41c98 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181516.434450:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b600/0x8f4f7840b2e41c98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181516.434458:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b600/0x8f4f7840b2e41c98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181516.435890:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151aa00/0x8f4f7840b2e41c9f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181516.435909:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151aa00/0x8f4f7840b2e41c9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181516.435920:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151aa00/0x8f4f7840b2e41c9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789181516.435969:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151aa00/0x8f4f7840b2e41c9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181516.435981:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e41c91 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181516.435988:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e41c91 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181516.435996:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e41c91 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181516.436018:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc18151ae00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:1.0:1789181516.436022:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e41c91 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181516.436029:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e41c91 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181516.436042:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9dc1995b7800) 00010000:00010000:1.0:1789181516.436044:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789181516.436049:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e41c91 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181516.436055:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e41c91 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181516.436073:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b600/0x8f4f7840b2e41c98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181516.436080:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b600/0x8f4f7840b2e41c98 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181516.436085:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b600/0x8f4f7840b2e41c98 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181516.436090:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc18151b600 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:1.0:1789181516.436092:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b600/0x8f4f7840b2e41c98 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181516.436098:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b600/0x8f4f7840b2e41c98 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181516.436915:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9dc18a6c2b00) 00010000:00010000:1.0:1789181516.436919:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789181516.436923:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b600/0x8f4f7840b2e41c98 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181516.436929:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b600/0x8f4f7840b2e41c98 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181516.436953:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151aa00/0x8f4f7840b2e41c9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181516.436959:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151aa00/0x8f4f7840b2e41c9f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181516.436965:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151aa00/0x8f4f7840b2e41c9f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181516.436970:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc18151aa00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:1.0:1789181516.436973:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151aa00/0x8f4f7840b2e41c9f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181516.436979:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151aa00/0x8f4f7840b2e41c9f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181516.436986:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9dc1995b7c00) 00010000:00010000:1.0:1789181516.436989:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789181516.436991:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151aa00/0x8f4f7840b2e41c9f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181516.436996:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151aa00/0x8f4f7840b2e41c9f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181516.437230:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1baba5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+31:11481:x1876092488065792:12345-192.168.204.32@tcp:34:lfs.0 Request processed in 3166us (7155us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181516.437240:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 163 00000100:00100000:3.0:1789181516.447052:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181516.447284:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488066048 00000100:00100000:0.0:1789181516.447295:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488066048 00000100:00100000:0.0:1789181516.447383:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 46 00000100:00100000:0.0:1789181516.447394:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b66ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+31:11481:x1876092488066048:12345-192.168.204.32@tcp:35:lfs.0 00000100:00100000:0.0:1789181516.447633:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b66ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+32:11481:x1876092488066048:12345-192.168.204.32@tcp:35:lfs.0 Request processed in 240us (593us total) trans 4294967452 rc 0/0 00000100:00100000:0.0:1789181516.447642:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 46 00000100:00100000:3.0:1789181516.500432:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181516.500589:0:6887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488066304 00000100:00100000:0.0:1789181516.500599:0:6887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488066304 00000100:00100000:0.0:1789181516.500664:0:6887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 164 00000100:00100000:0.0:1789181516.500676:0:6887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b66dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+32:11484:x1876092488066304:12345-192.168.204.32@tcp:101:lfs.0 00010000:00010000:0.0:1789181516.500701:0:6887:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181516.500745:0:6887:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891c00/0x8f4f7840b2e41ca6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f2a2 expref: -99 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181516.500846:0:6887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890600/0x8f4f7840b2e41cad lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181516.500860:0:6887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890600/0x8f4f7840b2e41cad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181516.500872:0:6887:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890600/0x8f4f7840b2e41cad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181516.500888:0:6887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891400/0x8f4f7840b2e41cb4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181516.500895:0:6887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891400/0x8f4f7840b2e41cb4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181516.500902:0:6887:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891400/0x8f4f7840b2e41cb4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181516.507386:0:6887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151aa00/0x8f4f7840b2e41cbb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181516.507409:0:6887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151aa00/0x8f4f7840b2e41cbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181516.507434:0:6887:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151aa00/0x8f4f7840b2e41cbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789181516.507446:0:6887:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1789181516.507552:0:6887:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890600/0x8f4f7840b2e41cad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181516.507561:0:6887:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890600/0x8f4f7840b2e41cad lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181516.507569:0:6887:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890600/0x8f4f7840b2e41cad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181516.507575:0:6887:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc189890600 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:1.0:1789181516.507579:0:6887:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890600/0x8f4f7840b2e41cad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181516.507587:0:6887:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890600/0x8f4f7840b2e41cad lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181516.507600:0:6887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9dc1995b7800) 00010000:00010000:1.0:1789181516.507610:0:6887:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789181516.507617:0:6887:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890600/0x8f4f7840b2e41cad lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181516.507622:0:6887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890600/0x8f4f7840b2e41cad lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181516.507636:0:6887:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891400/0x8f4f7840b2e41cb4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181516.507642:0:6887:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891400/0x8f4f7840b2e41cb4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181516.507648:0:6887:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891400/0x8f4f7840b2e41cb4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181516.507652:0:6887:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc189891400 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:1.0:1789181516.507655:0:6887:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891400/0x8f4f7840b2e41cb4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181516.507660:0:6887:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891400/0x8f4f7840b2e41cb4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181516.507668:0:6887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9dc18553a000) 00010000:00010000:1.0:1789181516.507670:0:6887:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789181516.507673:0:6887:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891400/0x8f4f7840b2e41cb4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181516.507677:0:6887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891400/0x8f4f7840b2e41cb4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181516.507738:0:6887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891c00/0x8f4f7840b2e41ca6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f2a2 expref: 35 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181516.507777:0:6887:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151aa00/0x8f4f7840b2e41cbb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f2a2 expref: 34 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181516.507785:0:6887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9dc1995b7c00) 00010000:00010000:1.0:1789181516.507787:0:6887:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789181516.507790:0:6887:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc18151aa00, rc 0) 00000100:00100000:1.0:1789181516.508154:0:6887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b66dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+34:11484:x1876092488066304:12345-192.168.204.32@tcp:101:lfs.0 Request processed in 7479us (7732us total) trans 4294967453 rc 0/0 00000100:00100000:1.0:1789181516.508163:0:6887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 164 00000100:00100000:3.0:1789181516.513320:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181516.513526:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181516.513764:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488066560 00000100:00100000:0.0:1789181516.513774:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488066560 00000100:00100000:0.0:1789181516.513839:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 165 00000100:00100000:0.0:1789181516.513850:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b66dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+34:11484:x1876092488066560:12345-192.168.204.32@tcp:54:lfs.0 00010000:00010000:0.0:1789181516.513922:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e41cc9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181516.513940:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e41cc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181516.513954:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e41cc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181516.513997:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e41cc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181516.514004:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e41cc9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181516.514012:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e41cc9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181516.514018:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc189890000 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:0.0:1789181516.514022:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e41cc9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181516.514030:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e41cc9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181516.514056:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9dc1995b7c00) 00010000:00010000:0.0:1789181516.514059:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789181516.514064:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e41cc9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181516.514070:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e41cc9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181516.514149:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b66dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+34:11484:x1876092488066560:12345-192.168.204.32@tcp:54:lfs.0 Request processed in 301us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181516.514157:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 165 00000100:00100000:3.0:1789181516.523523:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181516.523634:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488066816 00000100:00100000:0.0:1789181516.523645:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488066816 00000100:00100000:0.0:1789181516.523694:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 47 00000100:00100000:0.0:1789181516.523729:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b66dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+34:11484:x1876092488066816:12345-192.168.204.32@tcp:35:lfs.0 00000100:00100000:0.0:1789181516.523991:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b66dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+35:11484:x1876092488066816:12345-192.168.204.32@tcp:35:lfs.0 Request processed in 275us (477us total) trans 4294967454 rc 0/0 00000100:00100000:0.0:1789181516.524000:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 47 00000100:00100000:2.0:1789181516.524387:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488066432 00000100:00100000:2.0:1789181516.524393:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488066432 00000100:00100000:2.0:1789181516.524438:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 13 00000100:00100000:2.0:1789181516.524447:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b66df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+35:2354:x1876092488066432:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789181516.524460:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789181516.524484:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151aa00/0x8f4f7840b2e41cbb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f2a2 expref: 35 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181516.524509:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9dc1995b7c00) 00010000:00010000:2.0:1789181516.524515:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789181516.524552:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b66df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+34:2354:x1876092488066432:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 107us (11026us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181516.524559:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 13 00000100:00100000:3.0:1789181516.781860:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181516.782188:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488067072 00000100:00100000:2.0:1789181516.782199:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488067072 00000100:00100000:2.0:1789181516.782266:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 166 00000100:00100000:2.0:1789181516.782287:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+34:11502:x1876092488067072:12345-192.168.204.32@tcp:101:cat.0 00010000:00010000:2.0:1789181516.782313:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181516.782396:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259600/0x8f4f7840b2e41cd0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f2a9 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181516.782499:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258200/0x8f4f7840b2e41cd7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181516.782515:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258200/0x8f4f7840b2e41cd7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181516.782530:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258200/0x8f4f7840b2e41cd7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789181516.782542:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1789181516.782680:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259600/0x8f4f7840b2e41cd0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f2a9 expref: 37 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181516.782700:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258200/0x8f4f7840b2e41cd7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f2a9 expref: 36 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181516.782708:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9dc1995b7c00) 00010000:00010000:2.0:1789181516.782721:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789181516.782726:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1c0258200, rc 0) 00000100:00100000:2.0:1789181516.783889:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+36:11502:x1876092488067072:12345-192.168.204.32@tcp:101:cat.0 Request processed in 1608us (2033us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1789181516.783900:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 166 00000100:00100000:3.0:1789181516.823203:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181516.823354:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488067200 00000100:00100000:0.0:1789181516.823365:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488067200 00000100:00100000:0.0:1789181516.823421:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 167 00000100:00100000:0.0:1789181516.823431:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+36:11503:x1876092488067200:12345-192.168.204.32@tcp:101:lfs.0 00010000:00010000:0.0:1789181516.823453:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181516.823473:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e41ce5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f2b0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181516.823537:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891600/0x8f4f7840b2e41cec lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181516.823551:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891600/0x8f4f7840b2e41cec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181516.823563:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891600/0x8f4f7840b2e41cec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789181516.823595:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1789181516.823598:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789181516.823617:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891600/0x8f4f7840b2e41cec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181516.823643:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e41ce5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f2b0 expref: 38 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181516.823682:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891600/0x8f4f7840b2e41cec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f2b0 expref: 37 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181516.823692:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9dc1995b7800) 00010000:00010000:0.0:1789181516.823694:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789181516.823698:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc189891600, rc 0) 00000100:00100000:0.0:1789181516.823771:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+37:11503:x1876092488067200:12345-192.168.204.32@tcp:101:lfs.0 Request processed in 342us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181516.823778:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 167 00000100:00100000:3.0:1789181516.828558:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181516.828879:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488067584 00000100:00100000:1.0:1789181516.828891:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488067584 00000100:00100000:1.0:1789181516.828986:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 48 00000100:00100000:1.0:1789181516.828998:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+37:11503:x1876092488067584:12345-192.168.204.32@tcp:35:lfs.0 00000100:00100000:1.0:1789181516.829556:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+38:11503:x1876092488067584:12345-192.168.204.32@tcp:35:lfs.0 Request processed in 559us (1008us total) trans 4294967456 rc 0/0 00000100:00100000:1.0:1789181516.829565:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 48 00000100:00100000:0.0:1789181516.835295:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181516.835393:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488067712 00000100:00100000:3.0:1789181516.835405:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488067712 00000100:00100000:3.0:1789181516.835474:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 14 00000100:00100000:3.0:1789181516.835485:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c071e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+38:11503:x1876092488067712:12345-192.168.204.32@tcp:103:lfs.0 00010000:00010000:3.0:1789181516.835516:0:6707:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789181516.835544:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891000/0x8f4f7840b2e41c7c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f294 expref: 38 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181516.835567:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258200/0x8f4f7840b2e41cd7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f2a9 expref: 37 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181516.835582:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258600/0x8f4f7840b2e41b80 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f255 expref: 36 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181516.835592:0:6707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9dc1995b7c00) 00010000:00010000:3.0:1789181516.835602:0:6707:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789181516.835665:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c071e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+35:11503:x1876092488067712:12345-192.168.204.32@tcp:103:lfs.0 Request processed in 182us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181516.835672:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 14 00000100:00100000:3.0:1789181516.841248:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181516.841471:0:6887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488067840 00000100:00100000:1.0:1789181516.841481:0:6887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488067840 00000100:00100000:1.0:1789181516.841541:0:6887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 168 00000100:00100000:1.0:1789181516.841553:0:6887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+35:11503:x1876092488067840:12345-192.168.204.32@tcp:58:lfs.0 00010000:00010000:1.0:1789181516.841676:0:6887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b600/0x8f4f7840b2e41cf3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181516.841693:0:6887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b600/0x8f4f7840b2e41cf3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181516.841728:0:6887:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b600/0x8f4f7840b2e41cf3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789181516.842212:0:6887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:1.0:1789181516.842394:0:6887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+35:11503:x1876092488067840:12345-192.168.204.32@tcp:58:lfs.0 Request processed in 842us (1154us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181516.842403:0:6887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 168 00000100:00100000:0.0:1789181516.878049:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181516.878255:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488067968 00000100:00100000:2.0:1789181516.878267:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488067968 00000100:00100000:2.0:1789181516.878378:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 169 00000100:00100000:2.0:1789181516.878390:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c071f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+35:11505:x1876092488067968:12345-192.168.204.32@tcp:101:lfs.0 00010000:00010000:2.0:1789181516.878431:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181516.878454:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259600/0x8f4f7840b2e41cfa lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f2b7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181516.878526:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259c00/0x8f4f7840b2e41d01 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181516.878544:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259c00/0x8f4f7840b2e41d01 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181516.878557:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259c00/0x8f4f7840b2e41d01 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181516.878570:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258a00/0x8f4f7840b2e41d08 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181516.878577:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258a00/0x8f4f7840b2e41d08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181516.878583:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258a00/0x8f4f7840b2e41d08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181516.881367:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259400/0x8f4f7840b2e41d0f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181516.881391:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259400/0x8f4f7840b2e41d0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181516.881402:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259400/0x8f4f7840b2e41d0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789181516.881448:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1789181516.881463:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789181516.881486:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259400/0x8f4f7840b2e41d0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181516.881500:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259400/0x8f4f7840b2e41d0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181516.881509:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259c00/0x8f4f7840b2e41d01 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181516.881516:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259c00/0x8f4f7840b2e41d01 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181516.881523:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259c00/0x8f4f7840b2e41d01 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181516.881529:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1c0259c00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:2.0:1789181516.881533:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259c00/0x8f4f7840b2e41d01 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181516.881540:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259c00/0x8f4f7840b2e41d01 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181516.881552:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9dc1995b7800) 00010000:00010000:2.0:1789181516.881555:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789181516.881560:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259c00/0x8f4f7840b2e41d01 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181516.881567:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259c00/0x8f4f7840b2e41d01 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181516.881581:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258a00/0x8f4f7840b2e41d08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181516.881599:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258a00/0x8f4f7840b2e41d08 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181516.881605:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258a00/0x8f4f7840b2e41d08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181516.881611:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1c0258a00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:2.0:1789181516.881615:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258a00/0x8f4f7840b2e41d08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181516.881620:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258a00/0x8f4f7840b2e41d08 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181516.881629:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9dc1995b7e00) 00010000:00010000:2.0:1789181516.881631:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789181516.881634:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258a00/0x8f4f7840b2e41d08 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181516.881640:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258a00/0x8f4f7840b2e41d08 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181516.881683:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259600/0x8f4f7840b2e41cfa lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f2b7 expref: 37 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181516.881697:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259400/0x8f4f7840b2e41d0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f2b7 expref: 36 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181516.881705:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9dc18a6c2b00) 00010000:00010000:2.0:1789181516.881707:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789181516.881726:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1c0259400, rc 0) 00000100:00100000:2.0:1789181516.884257:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c071f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+36:11505:x1876092488067968:12345-192.168.204.32@tcp:101:lfs.0 Request processed in 5856us (6205us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181516.884281:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 169 00000040:00080000:3.0:1789181517.182570:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789181517.182580:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789181517.182657:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:3.0:1789181517.182666:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789181517.182805:0:11694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfb2ce00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11694:1876092510088064:192.168.204.32@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789181517.182913:0:11694:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1884b5540 going to sleep for 11 seconds 00000100:00100000:3.0:1789181517.187034:0:11694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfb2ce00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11694:1876092510088064:192.168.204.32@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789181517.190838:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181517.191163:0:6887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488068096 00000100:00100000:1.0:1789181517.191173:0:6887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488068096 00000100:00100000:1.0:1789181517.191294:0:6887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 170 00000100:00100000:1.0:1789181517.191305:0:6887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+36:11516:x1876092488068096:12345-192.168.204.32@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789181517.191376:0:6887:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789181517.191482:0:6887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+36:11516:x1876092488068096:12345-192.168.204.32@tcp:53:lhsmtool_posix.0 Request processed in 179us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181517.191490:0:6887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 170 00000100:00100000:0.0:1789181517.195537:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181517.195977:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488068224 00000100:00100000:1.0:1789181517.195988:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488068224 00000100:00100000:1.0:1789181517.196052:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 171 00000100:00100000:1.0:1789181517.196062:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c071c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+36:11516:x1876092488068224:12345-192.168.204.32@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789181517.196143:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ac00/0x8f4f7840b2e41d16 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.196159:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ac00/0x8f4f7840b2e41d16 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.196171:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ac00/0x8f4f7840b2e41d16 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.196282:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151a000/0x8f4f7840b2e41d1d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.196291:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151a000/0x8f4f7840b2e41d1d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.196299:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151a000/0x8f4f7840b2e41d1d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.196370:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e41d24 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.196381:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e41d24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.196388:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e41d24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789181517.196449:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1789181517.196455:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789181517.196470:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e41d24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181517.196482:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ac00/0x8f4f7840b2e41d16 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181517.196488:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ac00/0x8f4f7840b2e41d16 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181517.196495:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ac00/0x8f4f7840b2e41d16 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181517.196501:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc18151ac00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:2.0:1789181517.196505:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ac00/0x8f4f7840b2e41d16 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181517.196513:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ac00/0x8f4f7840b2e41d16 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181517.196524:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9dc192187200) 00010000:00010000:2.0:1789181517.196528:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789181517.196533:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ac00/0x8f4f7840b2e41d16 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181517.196540:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ac00/0x8f4f7840b2e41d16 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181517.196572:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151a000/0x8f4f7840b2e41d1d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181517.196579:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151a000/0x8f4f7840b2e41d1d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181517.196585:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151a000/0x8f4f7840b2e41d1d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181517.196590:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc18151a000 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:2.0:1789181517.196593:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151a000/0x8f4f7840b2e41d1d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181517.196599:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151a000/0x8f4f7840b2e41d1d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181517.196607:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff9dc18a6c2800) 00010000:00010000:2.0:1789181517.196609:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789181517.196612:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151a000/0x8f4f7840b2e41d1d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181517.196617:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151a000/0x8f4f7840b2e41d1d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181517.196837:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e41d24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181517.196846:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e41d24 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181517.196852:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e41d24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181517.196863:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc18151ae00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:2.0:1789181517.196866:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e41d24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181517.196872:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e41d24 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181517.196879:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9dc18a6c2b00) 00010000:00010000:2.0:1789181517.196881:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789181517.196884:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e41d24 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181517.196890:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e41d24 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181517.197005:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c071c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+36:11516:x1876092488068224:12345-192.168.204.32@tcp:34:lhsmtool_posix.0 Request processed in 943us (1475us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181517.197014:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 171 00000100:00100000:0.0:1789181517.203882:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181517.204019:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488068480 00000100:00100000:3.0:1789181517.204029:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488068480 00000100:00100000:3.0:1789181517.204161:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 172 00000100:00100000:3.0:1789181517.204174:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c071ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+36:11516:x1876092488068480:12345-192.168.204.32@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789181517.204197:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181517.204219:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ea00/0x8f4f7840b2e41d2b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f2be expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181517.204598:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e41d32 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181517.204615:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e41d32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181517.204847:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e41d32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789181517.204861:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1789181517.204963:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e41d32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181517.204972:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e41d32 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181517.204980:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e41d32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181517.204987:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1bfa1fc00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:3.0:1789181517.204991:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e41d32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181517.205000:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e41d32 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181517.205027:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9dc18a6c2b00) 00010000:00010000:3.0:1789181517.205030:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789181517.205036:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e41d32 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181517.205043:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e41d32 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181517.205085:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ea00/0x8f4f7840b2e41d2b lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f2be expref: 38 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181517.205096:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9dc192187200) 00010000:00010000:3.0:1789181517.205098:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789181517.205102:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ea00/0x8f4f7840b2e41d2b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f2be expref: 38 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181517.205401:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1bfa1ea00, rc 0) 00000100:00100000:3.0:1789181517.205501:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c071ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+37:11516:x1876092488068480:12345-192.168.204.32@tcp:101:lhsmtool_posix.0 Request processed in 1329us (1629us total) trans 4294967457 rc 301/301 00000100:00100000:3.0:1789181517.205510:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 172 00000100:00100000:3.0:1789181517.208691:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181517.208993:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488068608 00000100:00100000:0.0:1789181517.209003:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488068608 00000100:00100000:0.0:1789181517.209092:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 173 00000100:00100000:0.0:1789181517.209103:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc188548a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+37:11516:x1876092488068608:12345-192.168.204.32@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789181517.209148:0:5842:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789181517.209275:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc188548a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+37:11516:x1876092488068608:12345-192.168.204.32@tcp:53:lhsmtool_posix.0 Request processed in 173us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181517.209283:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 173 00000100:00100000:0.0:1789181517.216438:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181517.216527:0:6887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488068864 00000100:00100000:2.0:1789181517.216538:0:6887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488068864 00000100:00100000:2.0:1789181517.216596:0:6887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 174 00000100:00100000:2.0:1789181517.216608:0:6887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c071f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+37:11516:x1876092488068864:12345-192.168.204.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789181517.216648:0:6887:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181517.216652:0:6887:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789181517.216682:0:6887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891600/0x8f4f7840b2e41cec lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f2b0 expref: 37 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181517.216702:0:6887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9dc1995b7800) 00010000:00010000:2.0:1789181517.216734:0:6887:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789181517.216760:0:6887:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259c00/0x8f4f7840b2e41d40 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f2c5 expref: -99 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789181517.218120:0:6887:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:2.0:1789181517.218590:0:6887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259e00/0x8f4f7840b2e41d47 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181517.218606:0:6887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259e00/0x8f4f7840b2e41d47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181517.218617:0:6887:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259e00/0x8f4f7840b2e41d47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181517.218923:0:6887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259c00/0x8f4f7840b2e41d40 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f2c5 expref: 39 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181517.218942:0:6887:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259e00/0x8f4f7840b2e41d47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f2c5 expref: 38 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181517.218951:0:6887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9dc1995b7e00) 00010000:00010000:2.0:1789181517.218955:0:6887:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789181517.218958:0:6887:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1c0259e00, rc 0) 00000100:00100000:2.0:1789181517.219030:0:6887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c071f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+38:11516:x1876092488068864:12345-192.168.204.32@tcp:101:lhsmtool_posix.0 Request processed in 2425us (2607us total) trans 4294967458 rc 0/0 00000100:00100000:2.0:1789181517.219039:0:6887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 174 00000100:00100000:2.0:1789181517.224666:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181517.224762:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488069120 00000100:00100000:3.0:1789181517.224773:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488069120 00000100:00100000:3.0:1789181517.224839:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 175 00000100:00100000:3.0:1789181517.224850:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c01b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+38:11516:x1876092488069120:12345-192.168.204.32@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789181517.224908:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789181517.224934:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259e00/0x8f4f7840b2e41d47 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f2c5 expref: 38 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181517.224960:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9dc1995b7e00) 00010000:00010000:3.0:1789181517.224972:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789181517.224996:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ea00/0x8f4f7840b2e41d55 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181517.225009:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ea00/0x8f4f7840b2e41d55 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181517.225020:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ea00/0x8f4f7840b2e41d55 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181517.225069:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e41d5c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x53c5ba20 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181517.225078:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e41d5c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x53c5ba20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181517.225085:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e41d5c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x53c5ba20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181517.226057:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ea00/0x8f4f7840b2e41d55 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181517.226069:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ea00/0x8f4f7840b2e41d55 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181517.226076:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ea00/0x8f4f7840b2e41d55 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181517.226081:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1bfa1ea00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:3.0:1789181517.226085:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ea00/0x8f4f7840b2e41d55 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181517.226099:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ea00/0x8f4f7840b2e41d55 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181517.226574:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9dc1995b7800) 00010000:00010000:3.0:1789181517.226579:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181517.226584:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ea00/0x8f4f7840b2e41d55 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181517.226591:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ea00/0x8f4f7840b2e41d55 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181517.226604:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e41d5c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x53c5ba20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181517.226610:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e41d5c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x53c5ba20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181517.226616:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e41d5c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x53c5ba20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181517.226621:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1bfa1fc00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:3.0:1789181517.226798:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e41d5c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x53c5ba20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181517.226806:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e41d5c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x53c5ba20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181517.226815:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x53c5ba20 (ffff9dc192187e00) 00010000:00010000:3.0:1789181517.226818:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181517.226821:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e41d5c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x53c5ba20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181517.226840:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e41d5c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x53c5ba20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181517.226992:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c01b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+37:11516:x1876092488069120:12345-192.168.204.32@tcp:36:lhsmtool_posix.0 Request processed in 2141us (2333us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789181517.227001:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 175 00000100:00100000:3.0:1789181517.229844:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181517.229921:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488069248 00000100:00100000:0.0:1789181517.229931:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488069248 00000100:00100000:0.0:1789181517.229984:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 176 00000100:00100000:0.0:1789181517.230007:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc188548000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+37:11516:x1876092488069248:12345-192.168.204.32@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789181517.230029:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181517.230053:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890a00/0x8f4f7840b2e41d63 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f2cc expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181517.230086:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891000/0x8f4f7840b2e41d6a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181517.230100:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891000/0x8f4f7840b2e41d6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181517.230112:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891000/0x8f4f7840b2e41d6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181517.230215:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890a00/0x8f4f7840b2e41d63 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f2cc expref: 39 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181517.230233:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891000/0x8f4f7840b2e41d6a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f2cc expref: 38 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181517.230241:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9dc18553a000) 00010000:00010000:0.0:1789181517.230244:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789181517.230247:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc189891000, rc 0) 00000100:00100000:0.0:1789181517.230319:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc188548000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+38:11516:x1876092488069248:12345-192.168.204.32@tcp:101:lhsmtool_posix.0 Request processed in 315us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181517.230326:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 176 00000100:00100000:0.0:1789181517.237999:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181517.238096:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488069504 00000100:00100000:2.0:1789181517.238117:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488069504 00000100:00100000:2.0:1789181517.238201:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 177 00000100:00100000:2.0:1789181517.238214:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c071e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+38:11516:x1876092488069504:12345-192.168.204.32@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789181517.238309:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259c00/0x8f4f7840b2e41d71 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181517.238327:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259c00/0x8f4f7840b2e41d71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181517.238375:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259c00/0x8f4f7840b2e41d71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789181517.238648:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:2.0:1789181517.238657:0:5842:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 409495325327ns, next at 410495323312ns, rc = 0 00000004:00010000:2.0:1789181517.238761:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002cba8804 reply state 0000000003ebeca2 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259c00/0x8f4f7840b2e41d71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181517.238771:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789181517.238870:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c071e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+40:11516:x1876092488069504:12345-192.168.204.32@tcp:36:lhsmtool_posix.0 Request processed in 659us (882us total) trans 4294967459 rc 0/0 00000100:00100000:2.0:1789181517.238878:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 177 00010000:00010000:1.0:1789181517.252814:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259c00/0x8f4f7840b2e41d71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.252832:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259c00/0x8f4f7840b2e41d71 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.252840:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259c00/0x8f4f7840b2e41d71 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.252846:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1c0259c00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:1.0:1789181517.252851:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259c00/0x8f4f7840b2e41d71 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.252858:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259c00/0x8f4f7840b2e41d71 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.252887:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9dc18553a000) 00010000:00010000:1.0:1789181517.252890:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789181517.252896:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259c00/0x8f4f7840b2e41d71 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.252903:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259c00/0x8f4f7840b2e41d71 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181517.254571:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181517.255682:0:6887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488069632 00000100:00100000:3.0:1789181517.255696:0:6887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488069632 00000100:00100000:3.0:1789181517.255774:0:6887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 178 00000100:00100000:3.0:1789181517.255786:0:6887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0833d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+39:11516:x1876092488069632:12345-192.168.204.32@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789181517.255809:0:6887:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181517.255829:0:6887:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e41d78 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f2d3 expref: -99 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181517.255885:0:6887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e41d78 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f2d3 expref: 40 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181517.255899:0:6887:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e41d78 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f2d3 expref: 40 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181517.255918:0:6887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9dc18553a000) 00010000:00010000:3.0:1789181517.255921:0:6887:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789181517.255925:0:6887:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1bfa1fc00, rc 0) 00000100:00100000:3.0:1789181517.255980:0:6887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0833d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+40:11516:x1876092488069632:12345-192.168.204.32@tcp:101:lhsmtool_posix.0 Request processed in 197us (1418us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181517.255998:0:6887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 178 00000100:00100000:3.0:1789181517.260900:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181517.261274:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488069760 00000100:00100000:2.0:1789181517.261284:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488069760 00000100:00100000:2.0:1789181517.261368:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 52 00000100:00100000:2.0:1789181517.261379:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc188549880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+6:2354:x1876092488069760:12345-192.168.204.32@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1789181517.263978:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789181517.264393:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc188549880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+7:2354:x1876092488069760:12345-192.168.204.32@tcp:2:lhsmtool_posix.0 Request processed in 3008us (3493us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1789181517.264406:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 52 00000100:00100000:2.0:1789181517.276821:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181517.279481:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488070016 00000100:00100000:3.0:1789181517.279495:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488070016 00000100:00100000:3.0:1789181517.279608:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 49 00000100:00100000:3.0:1789181517.279619:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c01b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+40:11516:x1876092488070016:12345-192.168.204.32@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789181517.279930:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c01b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+41:11516:x1876092488070016:12345-192.168.204.32@tcp:35:lhsmtool_posix.0 Request processed in 312us (3114us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1789181517.279937:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 49 00000100:00100000:0.0:1789181517.291427:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181517.291507:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488070272 00000100:00100000:3.0:1789181517.291516:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488070272 00000100:00100000:3.0:1789181517.291567:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 179 00000100:00100000:3.0:1789181517.291583:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c071ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+41:11516:x1876092488070272:12345-192.168.204.32@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789181517.291964:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c071ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+41:11516:x1876092488070272:12345-192.168.204.32@tcp:57:lhsmtool_posix.0 Request processed in 381us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181517.291973:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 179 00000100:00100000:1.0:1789181517.295325:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181517.295532:0:6887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488070400 00000100:00100000:3.0:1789181517.295544:0:6887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488070400 00000100:00100000:3.0:1789181517.295640:0:6887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 180 00000100:00100000:3.0:1789181517.295651:0:6887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0833d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+41:11516:x1876092488070400:12345-192.168.204.32@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789181517.295670:0:6887:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181517.295692:0:6887:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ea00/0x8f4f7840b2e41d7f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f2da expref: -99 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181517.295903:0:6887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e800/0x8f4f7840b2e41d86 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181517.295920:0:6887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e800/0x8f4f7840b2e41d86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181517.295932:0:6887:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e800/0x8f4f7840b2e41d86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789181517.295968:0:6887:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789181517.295987:0:6887:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e800/0x8f4f7840b2e41d86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181517.296013:0:6887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ea00/0x8f4f7840b2e41d7f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f2da expref: 43 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181517.296031:0:6887:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e800/0x8f4f7840b2e41d86 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f2da expref: 42 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181517.296040:0:6887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9dc18553a000) 00010000:00010000:3.0:1789181517.296043:0:6887:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789181517.296047:0:6887:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1bfa1e800, rc 0) 00000100:00100000:3.0:1789181517.296113:0:6887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0833d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+42:11516:x1876092488070400:12345-192.168.204.32@tcp:101:lhsmtool_posix.0 Request processed in 463us (926us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181517.296121:0:6887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 180 00000100:00100000:2.0:1789181517.298962:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181517.299041:0:6894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488070528 00000100:00100000:3.0:1789181517.299051:0:6894:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488070528 00000100:00100000:3.0:1789181517.299129:0:6894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 53 00000100:00100000:3.0:1789181517.299150:0:6894:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c01b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+7:2354:x1876092488070528:12345-192.168.204.32@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789181517.299170:0:6894:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181517.299201:0:6894:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d47cdaa/0x8f4f7840b2e41d8d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f2e1 expref: -99 pid: 6894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789181517.299227:0:6894:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa4be4e, blocks: 0x1 00010000:00010000:3.0:1789181517.299244:0:6894:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=409s v=(0 0) 00010000:00010000:3.0:1789181517.299248:0:6894:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789181517.299257:0:6894:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d47cdaa/0x8f4f7840b2e41d8d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f2e1 expref: 8 pid: 6894 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181517.299284:0:6894:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005d47cdaa/0x8f4f7840b2e41d8d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f2e1 expref: 8 pid: 6894 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181517.299296:0:6894:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1bfa1f400, rc 0) 00000100:00100000:3.0:1789181517.299371:0:6894:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c01b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+8:2354:x1876092488070528:12345-192.168.204.32@tcp:101:lhsmtool_posix.0 Request processed in 223us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181517.299377:0:6894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 53 00000100:00100000:2.0:1789181517.303995:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181517.304063:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488070784 00000100:00100000:3.0:1789181517.304073:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488070784 00000100:00100000:3.0:1789181517.304129:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 181 00000100:00100000:3.0:1789181517.304139:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c01b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+42:11516:x1876092488070784:12345-192.168.204.32@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789181517.304254:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c01b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+42:11516:x1876092488070784:12345-192.168.204.32@tcp:57:lhsmtool_posix.0 Request processed in 116us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181517.304273:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 181 00000100:00100000:3.0:1789181517.307305:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181517.307541:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488070912 00000100:00100000:1.0:1789181517.307550:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488070912 00000100:00100000:1.0:1789181517.307602:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 54 00000100:00100000:1.0:1789181517.307611:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6af0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+8:11516:x1876092488070912:12345-192.168.204.32@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789181517.307637:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181517.307656:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e1832511/0x8f4f7840b2e41d94 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f2e8 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.307686:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005d47cdaa/0x8f4f7840b2e41d8d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f2e1 expref: 9 pid: 6894 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.307696:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789181517.307701:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789181517.307717:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1832511/0x8f4f7840b2e41d94 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f2e8 expref: 9 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.307859:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005d47cdaa/0x8f4f7840b2e41d8d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f2e1 expref: 9 pid: 6894 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.307882:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005d47cdaa/0x8f4f7840b2e41d8d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f2e1 expref: 9 pid: 6894 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181517.307897:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1a7309500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6691:1876092510088192:192.168.204.32@tcp:104: 00000100:00100000:1.0:1789181517.307983:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc0821f4cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789181517.312021:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181517.312052:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488071040 00000100:00100000:1.0:1789181517.312060:0:8456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488071040 00000100:00100000:3.0:1789181517.312150:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1a7309500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6691:1876092510088192:192.168.204.32@tcp:104: 00010000:00010000:3.0:1789181517.312184:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e1832511/0x8f4f7840b2e41d94 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f2e8 expref: 10 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181517.312217:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc18151aa00, rc 0) 00000100:00100000:3.0:1789181517.312276:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6af0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+10:11516:x1876092488070912:12345-192.168.204.32@tcp:101:lhsmtool_posix.0 Request processed in 4666us (4981us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181517.312284:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 54 00010000:00010000:1.0:1789181517.317089:0:8456:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005d47cdaa/0x8f4f7840b2e41d8d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f2e1 expref: 9 pid: 6894 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181517.317151:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 68 00000100:00100000:1.0:1789181517.317169:0:8456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19619f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5971a429-48ca-4c07-88a3-fa58102a53bc+9:2353:x1876092488071040:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789181517.317187:0:8456:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789181517.317212:0:8456:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005d47cdaa/0x8f4f7840b2e41d8d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f2e1 expref: 9 pid: 6894 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.317226:0:8456:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005d47cdaa/0x8f4f7840b2e41d8d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f2e1 expref: 9 pid: 6894 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.317251:0:8456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d47cdaa/0x8f4f7840b2e41d8d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f2e1 expref: 9 pid: 6894 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.317395:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789181517.317408:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789181517.317417:0:8456:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e1832511/0x8f4f7840b2e41d94 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f2e8 expref: 8 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.317429:0:8456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1832511/0x8f4f7840b2e41d94 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f2e8 expref: 8 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.317584:0:8456:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e1832511/0x8f4f7840b2e41d94 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f2e8 expref: 8 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181517.317599:0:8456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1a7308700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8456:1876092510088320:192.168.204.32@tcp:105: 00000100:00100000:1.0:1789181517.317880:0:8456:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc0821f4840 going to sleep for 11 seconds 00000100:00100000:0.0:1789181517.329514:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181517.329563:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488071168 00000100:00100000:0.0:1789181517.329573:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488071168 00002000:00100000:0.0:1789181517.329624:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9dc1c071f800 x1876092488071168/t0(0) o4->5971a429-48ca-4c07-88a3-fa58102a53bc@192.168.204.32@tcp:648/0 lens 504/0 e 0 to 0 dl 1789181528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789181517.330407:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9dc1c071f800 with x1876092488071168 ext(0->8) 00002000:00010000:0.0:1789181517.330415:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9dc1c071f800 00000100:00100000:0.0:1789181517.330452:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 5 00000100:00100000:0.0:1789181517.330465:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c071f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+9:2354:x1876092488071168:12345-192.168.204.32@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789181517.330565:0:8456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1a7308700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8456:1876092510088320:192.168.204.32@tcp:105: 00010000:00010000:2.0:1789181517.330587:0:8456:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789181517.330646:0:8456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19619f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5971a429-48ca-4c07-88a3-fa58102a53bc+9:2353:x1876092488071040:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 13486us (18632us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181517.330656:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 68 00000100:00100000:0.0:1789181517.330894:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c071f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+10:2354:x1876092488071168:12345-192.168.204.32@tcp:4:lhsmtool_posix.0 Request processed in 432us (1389us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1789181517.330903:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 5 00002000:00100000:0.0:1789181517.330911:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9dc1c071f800 x1876092488071168/t4294967315(0) o4->5971a429-48ca-4c07-88a3-fa58102a53bc@192.168.204.32@tcp:648/0 lens 504/448 e 0 to 0 dl 1789181528 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789181517.330920:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9dc1c071f800 with x1876092488071168 ext(0->8) 00002000:00010000:0.0:1789181517.330923:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9dc1c071f800 00000100:00100000:0.0:1789181517.340212:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181517.340306:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488071296 00000100:00100000:1.0:1789181517.340317:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488071296 00000100:00100000:1.0:1789181517.340396:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 182 00000100:00100000:1.0:1789181517.340407:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c071ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+42:11516:x1876092488071296:12345-192.168.204.32@tcp:44:lhsmtool_posix.0 00010000:00010000:3.0:1789181517.377550:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789181517.390249:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967454 is committed 00000100:00100000:3.0:1789181517.390514:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c071ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+42:11516:x1876092488071296:12345-192.168.204.32@tcp:44:lhsmtool_posix.0 Request processed in 50101us (50303us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181517.390525:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 182 00000020:00080000:1.0:1789181517.390769:0:5865:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000001:00080000:1.0:1789181517.390789:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967456 is committed 00000001:00080000:1.0:1789181517.390803:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000004:00080000:1.0:1789181517.390806:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000001:00080000:1.0:1789181517.390823:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000100:00100000:3.0:1789181517.391053:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789181517.391067:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6af0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510088448:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789181517.391119:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181517.391161:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510088448 00000100:00100000:3.0:1789181517.391168:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510088448 00000100:00100000:3.0:1789181517.391211:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789181517.391219:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6af3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510088448:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1789181517.391411:0:6693:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1789181517.391416:0:6693:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1789181518 00002000:00010000:3.0:1789181517.391418:0:6693:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789181517.391421:0:6693:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789181518 -> 1789181518 00002000:00010000:3.0:1789181517.391423:0:6693:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1789181517.391458:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6af3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3305:x1876092510088448:12345-0@lo:2:osp-syn-1-0.0 Request processed in 239us (338us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1789181517.391474:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:3.0:1789181517.391493:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1789181517.391524:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9dc1b6af0380/2, rc 0, transno 4294967316 00000100:00100000:3.0:1789181517.391530:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6af0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510088448:0@lo:2:osp-syn-1-0.0 00000020:00080000:0.0:1789181517.391678:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:0.0:1789181517.391692:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1789181517.395047:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181517.395131:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488071424 00000100:00100000:3.0:1789181517.395141:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488071424 00000100:00100000:3.0:1789181517.395229:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 56 00000100:00100000:3.0:1789181517.395239:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1a7308700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+10:2353:x1876092488071424:12345-192.168.204.32@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1789181517.425065:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1a7308700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+10:2353:x1876092488071424:12345-192.168.204.32@tcp:16:lhsmtool_posix.0 Request processed in 29818us (30018us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181517.425077:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 56 00000001:00080000:1.0:1789181517.425191:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000001:00080000:1.0:1789181517.425208:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000100:00100000:2.0:1789181517.428239:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181517.429832:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488071680 00000100:00100000:3.0:1789181517.429844:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488071680 00000100:00100000:1.0:1789181517.430033:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 183 00000100:00100000:1.0:1789181517.430045:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c01b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+18:11516:x1876092488071680:12345-192.168.204.32@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789181517.430099:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789181517.430134:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e800/0x8f4f7840b2e41d86 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f2da expref: 18 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.430152:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9dc18553a000) 00010000:00010000:1.0:1789181517.430157:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789181517.430184:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b400/0x8f4f7840b2e41d9b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.430197:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b400/0x8f4f7840b2e41d9b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.430206:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b400/0x8f4f7840b2e41d9b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789181517.430479:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b739fd75 reply state 000000002d63d3fb transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b400/0x8f4f7840b2e41d9b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181517.430489:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789181517.430583:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c01b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+19:11516:x1876092488071680:12345-192.168.204.32@tcp:36:lhsmtool_posix.0 Request processed in 539us (2350us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1789181517.430590:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 183 00010000:00010000:3.0:1789181517.434557:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b400/0x8f4f7840b2e41d9b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181517.434575:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b400/0x8f4f7840b2e41d9b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181517.434583:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b400/0x8f4f7840b2e41d9b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181517.434589:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc18151b400 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:3.0:1789181517.434594:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b400/0x8f4f7840b2e41d9b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181517.434603:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b400/0x8f4f7840b2e41d9b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181517.434642:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9dc18553a000) 00010000:00010000:3.0:1789181517.434645:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181517.434650:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b400/0x8f4f7840b2e41d9b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181517.434657:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b400/0x8f4f7840b2e41d9b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181517.434988:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181517.435017:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488071808 00000100:00100000:2.0:1789181517.435025:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488071808 00000100:00100000:2.0:1789181517.435062:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 57 00000100:00100000:2.0:1789181517.435071:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c01b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+7:2354:x1876092488071808:12345-192.168.204.32@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789181517.435297:0:6693:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1789181517.435300:0:6693:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1789181518 -> 1789181517 00002000:00010000:2.0:1789181517.435303:0:6693:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1789181515 00002000:00010000:2.0:1789181517.435305:0:6693:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789181518 -> 1789181517 00002000:00010000:2.0:1789181517.435308:0:6693:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1789181517.435385:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c01b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+8:2354:x1876092488071808:12345-192.168.204.32@tcp:2:lhsmtool_posix.0 Request processed in 313us (400us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1789181517.435392:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 57 00000100:00100000:2.0:1789181517.438789:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181517.438875:0:6887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488072064 00000100:00100000:3.0:1789181517.438884:0:6887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488072064 00000100:00100000:3.0:1789181517.438960:0:6887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 184 00000100:00100000:3.0:1789181517.438970:0:6887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c01b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+18:11516:x1876092488072064:12345-192.168.204.32@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789181517.439042:0:6887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f800/0x8f4f7840b2e41da2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181517.439059:0:6887:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891000/0x8f4f7840b2e41d6a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f2cc expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181517.439068:0:6887:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f800/0x8f4f7840b2e41da2 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181517.439099:0:6887:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891000/0x8f4f7840b2e41d6a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f2cc expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181517.439113:0:6887:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891000/0x8f4f7840b2e41d6a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f2cc expref: 18 pid: 5844 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181517.439127:0:6887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6af2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6887:1876092510088576:192.168.204.32@tcp:104: 00000100:00100000:3.0:1789181517.439213:0:6887:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1884b5540 going to sleep for 11 seconds 00000100:00100000:2.0:1789181517.441969:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181517.442018:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488072192 00000100:00100000:0.0:1789181517.442026:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488072192 00010000:00010000:0.0:1789181517.442066:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891000/0x8f4f7840b2e41d6a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f2cc expref: 19 pid: 5844 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181517.442110:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 69 00000100:00100000:0.0:1789181517.442119:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c01b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+19:2354:x1876092488072192:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789181517.442143:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789181517.442150:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891000/0x8f4f7840b2e41d6a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f2cc expref: 19 pid: 5844 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181517.442163:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891000/0x8f4f7840b2e41d6a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f2cc expref: 19 pid: 5844 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181517.442184:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9dc18553a000) 00010000:00010000:0.0:1789181517.442189:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f800/0x8f4f7840b2e41da2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181517.442198:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f800/0x8f4f7840b2e41da2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181517.442206:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f800/0x8f4f7840b2e41da2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181517.442237:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789181517.442283:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c01b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+19:2354:x1876092488072192:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 165us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181517.442291:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 69 00010000:00010000:3.0:1789181517.442957:0:6887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891000/0x8f4f7840b2e41d6a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f2cc expref: 18 pid: 5844 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181517.442973:0:6887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6af2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6887:1876092510088576:192.168.204.32@tcp:104: 00010000:00010000:3.0:1789181517.442992:0:6887:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f800/0x8f4f7840b2e41da2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181517.443001:0:6887:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f800/0x8f4f7840b2e41da2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181517.443007:0:6887:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f800/0x8f4f7840b2e41da2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181517.443033:0:6887:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f800/0x8f4f7840b2e41da2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181517.443040:0:6887:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f800/0x8f4f7840b2e41da2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181517.443047:0:6887:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f800/0x8f4f7840b2e41da2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181517.443053:0:6887:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1bfa1f800 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:3.0:1789181517.443057:0:6887:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f800/0x8f4f7840b2e41da2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181517.443064:0:6887:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f800/0x8f4f7840b2e41da2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181517.443073:0:6887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9dc18553a000) 00010000:00010000:3.0:1789181517.443084:0:6887:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789181517.443088:0:6887:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f800/0x8f4f7840b2e41da2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181517.443094:0:6887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f800/0x8f4f7840b2e41da2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181517.443197:0:6887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c01b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+17:11516:x1876092488072064:12345-192.168.204.32@tcp:55:lhsmtool_posix.0 Request processed in 4228us (4582us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789181517.443205:0:6887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 184 00000100:00100000:2.0:1789181517.446183:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181517.446270:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488072320 00000100:00100000:1.0:1789181517.446279:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488072320 00000100:00100000:1.0:1789181517.446363:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 58 00000100:00100000:1.0:1789181517.446374:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c01b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+8:2353:x1876092488072320:12345-192.168.204.32@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789181517.446417:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008a84c095/0x8f4f7840b2e41da9 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.446449:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e1832511/0x8f4f7840b2e41d94 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f2e8 expref: 8 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.446458:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789181517.446463:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789181517.446471:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a84c095/0x8f4f7840b2e41da9 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.446506:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e1832511/0x8f4f7840b2e41d94 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f2e8 expref: 8 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.446519:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e1832511/0x8f4f7840b2e41d94 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f2e8 expref: 8 pid: 6691 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181517.446533:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1a7309500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6691:1876092510088704:192.168.204.32@tcp:104: 00000100:00100000:1.0:1789181517.446606:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc08311d9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789181517.450418:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1a7309500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6691:1876092510088704:192.168.204.32@tcp:104: 00010000:00010000:3.0:1789181517.450451:0:6691:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008a84c095/0x8f4f7840b2e41da9 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181517.451611:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181517.451643:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488072448 00000100:00100000:2.0:1789181517.451660:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488072448 00010000:00010000:2.0:1789181517.451697:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e1832511/0x8f4f7840b2e41d94 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f2e8 expref: 9 pid: 6691 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181517.451750:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 70 00000100:00100000:2.0:1789181517.451761:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c01b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+9:2353:x1876092488072448:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789181517.451776:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789181517.451798:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e1832511/0x8f4f7840b2e41d94 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f2e8 expref: 9 pid: 6691 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181517.451812:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e1832511/0x8f4f7840b2e41d94 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f2e8 expref: 9 pid: 6691 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181517.451835:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e1832511/0x8f4f7840b2e41d94 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f2e8 expref: 9 pid: 6691 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181517.451850:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789181517.451855:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789181517.451860:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008a84c095/0x8f4f7840b2e41da9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181517.451870:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a84c095/0x8f4f7840b2e41da9 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181517.451897:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789181517.451940:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c01b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+8:2353:x1876092488072448:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 181us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181517.451957:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 70 00010000:00010000:2.0:1789181517.451985:0:6691:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008a84c095/0x8f4f7840b2e41da9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181517.451994:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008a84c095/0x8f4f7840b2e41da9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181517.452017:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008a84c095/0x8f4f7840b2e41da9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181517.452025:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008a84c095/0x8f4f7840b2e41da9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181517.452033:0:6691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008a84c095/0x8f4f7840b2e41da9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181517.452040:0:6691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc18151a800 already unused, calling callback (ffffffffc152f9b0) 00010000:00010000:2.0:1789181517.452045:0:6691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008a84c095/0x8f4f7840b2e41da9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181517.452054:0:6691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008a84c095/0x8f4f7840b2e41da9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181517.452066:0:6691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008a84c095/0x8f4f7840b2e41da9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181517.452086:0:6691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008a84c095/0x8f4f7840b2e41da9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181517.452129:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c01b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+7:2353:x1876092488072320:12345-192.168.204.32@tcp:1:lhsmtool_posix.0 Request processed in 5757us (5952us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181517.452136:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 58 00000100:00100000:2.0:1789181517.456476:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181517.457207:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488072704 00000100:00100000:3.0:1789181517.457218:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488072704 00000100:00100000:3.0:1789181517.457276:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 185 00000100:00100000:3.0:1789181517.457285:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c01b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+17:11516:x1876092488072704:12345-192.168.204.32@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789181517.457375:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f800/0x8f4f7840b2e41db0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181517.457393:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f800/0x8f4f7840b2e41db0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181517.457405:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f800/0x8f4f7840b2e41db0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181517.457602:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ea00/0x8f4f7840b2e41db7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181517.457840:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e41d78 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f2d3 expref: 18 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181517.457851:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ea00/0x8f4f7840b2e41db7 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181517.457883:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e41d78 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f2d3 expref: 18 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181517.457897:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e41d78 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f2d3 expref: 18 pid: 6887 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181517.457909:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6af2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1876092510088832:192.168.204.32@tcp:104: 00000100:00100000:3.0:1789181517.457988:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1884b5540 going to sleep for 11 seconds 00000100:00100000:3.0:1789181517.460128:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6af2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1876092510088832:192.168.204.32@tcp:104: 00010000:00010000:3.0:1789181517.460154:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ea00/0x8f4f7840b2e41db7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181517.461784:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181517.462095:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488072832 00000100:00100000:3.0:1789181517.462199:0:8456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488072832 00010000:00010000:3.0:1789181517.462242:0:8456:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e41d78 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f2d3 expref: 19 pid: 6887 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181517.462361:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 71 00000100:00100000:3.0:1789181517.462371:0:8456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c01b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5971a429-48ca-4c07-88a3-fa58102a53bc+19:2353:x1876092488072832:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789181517.462389:0:8456:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789181517.462402:0:8456:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e41d78 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f2d3 expref: 19 pid: 6887 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181517.462416:0:8456:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e41d78 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f2d3 expref: 19 pid: 6887 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181517.462438:0:8456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e41d78 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f2d3 expref: 19 pid: 6887 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181517.462450:0:8456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9dc18553a000) 00010000:00010000:3.0:1789181517.462455:0:8456:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ea00/0x8f4f7840b2e41db7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181517.462464:0:8456:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ea00/0x8f4f7840b2e41db7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181517.462471:0:8456:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ea00/0x8f4f7840b2e41db7 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181517.462500:0:8456:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789181517.462547:0:8456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c01b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5971a429-48ca-4c07-88a3-fa58102a53bc+18:2353:x1876092488072832:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 177us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181517.462555:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 71 00010000:00010000:2.0:1789181517.462816:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ea00/0x8f4f7840b2e41db7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181517.462825:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ea00/0x8f4f7840b2e41db7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789181517.463005:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:2.0:1789181517.463147:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:2.0:1789181517.463193:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:2.0:1789181517.463271:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c01b3800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5843:1876092510088960:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789181517.463320:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181517.463373:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1a72fa240 going to sleep for 11 seconds 00000100:00100000:3.0:1789181517.463403:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510088960 00000100:00100000:3.0:1789181517.463408:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510088960 00000100:00100000:3.0:1789181517.463444:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789181517.463451:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c01b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5843:x1876092510088960:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789181517.463518:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c01b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5843:x1876092510088960:12345-0@lo:1000:mdt00_001.0 Request processed in 66us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181517.463533:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789181517.463606:0:5843:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:0.0:1789181517.463612:0:5843:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9dc1b6af0380, transno 4294967316 00000100:00100000:0.0:1789181517.463640:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c01b3800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5843:1876092510088960:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1789181517.464076:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:0.0:1789181517.464140:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c071ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5843:1876092510089088:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789181517.464169:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181517.464184:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1a72fad80 going to sleep for 11 seconds 00000100:00100000:3.0:1789181517.464737:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510089088 00000100:00100000:3.0:1789181517.464743:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510089088 00000100:00100000:3.0:1789181517.464779:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789181517.464790:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c071dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5843:x1876092510089088:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789181517.465372:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c071ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5843:1876092510089088:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1789181517.465405:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ea00/0x8f4f7840b2e41db7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181517.465415:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ea00/0x8f4f7840b2e41db7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181517.465434:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ea00/0x8f4f7840b2e41db7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181517.465441:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1bfa1ea00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:2.0:1789181517.465445:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ea00/0x8f4f7840b2e41db7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181517.465453:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ea00/0x8f4f7840b2e41db7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181517.465457:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c071dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5843:x1876092510089088:12345-0@lo:1000:mdt00_001.0 Request processed in 670us (1286us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1789181517.465464:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1789181517.465467:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9dc18553a000) 00010000:00010000:2.0:1789181517.465470:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789181517.465475:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ea00/0x8f4f7840b2e41db7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181517.465481:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ea00/0x8f4f7840b2e41db7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181517.465514:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b600/0x8f4f7840b2e41cf3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181517.465521:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b600/0x8f4f7840b2e41cf3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181517.465527:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b600/0x8f4f7840b2e41cf3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181517.465532:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc18151b600 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:2.0:1789181517.465535:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b600/0x8f4f7840b2e41cf3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181517.465550:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b600/0x8f4f7840b2e41cf3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181517.465558:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9dc18a6c2b00) 00010000:00010000:2.0:1789181517.465560:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789181517.465563:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b600/0x8f4f7840b2e41cf3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181517.465568:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b600/0x8f4f7840b2e41cf3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181517.465594:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258400/0x8f4f7840b2e41dbe lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181517.465608:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259400/0x8f4f7840b2e41d0f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f2b7 expref: 21 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181517.465616:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258400/0x8f4f7840b2e41dbe lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181517.465643:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259400/0x8f4f7840b2e41d0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f2b7 expref: 21 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181517.465656:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259400/0x8f4f7840b2e41d0f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f2b7 expref: 21 pid: 5842 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181517.465668:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c01b3800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1876092510089216:192.168.204.32@tcp:104: 00000100:00100000:2.0:1789181517.465753:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc0821f4840 going to sleep for 11 seconds 00000100:00100000:3.0:1789181517.468104:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c01b3800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1876092510089216:192.168.204.32@tcp:104: 00010000:00010000:3.0:1789181517.468267:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258400/0x8f4f7840b2e41dbe lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181517.468270:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181517.468538:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488072960 00000100:00100000:2.0:1789181517.468553:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488072960 00010000:00010000:2.0:1789181517.468587:0:6707:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259400/0x8f4f7840b2e41d0f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f2b7 expref: 22 pid: 5842 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181517.468830:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 72 00000100:00100000:2.0:1789181517.468841:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c071e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+22:2354:x1876092488072960:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789181517.468856:0:6707:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789181517.468864:0:6707:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259400/0x8f4f7840b2e41d0f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f2b7 expref: 22 pid: 5842 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181517.468876:0:6707:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259400/0x8f4f7840b2e41d0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f2b7 expref: 22 pid: 5842 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181517.468897:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259400/0x8f4f7840b2e41d0f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f2b7 expref: 22 pid: 5842 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181517.468912:0:6707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9dc18a6c2b00) 00010000:00010000:2.0:1789181517.468918:0:6707:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258400/0x8f4f7840b2e41dbe lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181517.468927:0:6707:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258400/0x8f4f7840b2e41dbe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181517.468935:0:6707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258400/0x8f4f7840b2e41dbe lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181517.468968:0:6707:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789181517.469019:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c071e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+21:2354:x1876092488072960:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 181us (750us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181517.469037:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 72 00010000:00010000:0.0:1789181517.469168:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258400/0x8f4f7840b2e41dbe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181517.469181:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258400/0x8f4f7840b2e41dbe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181517.469192:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258400/0x8f4f7840b2e41dbe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181517.469198:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258400/0x8f4f7840b2e41dbe lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181517.469205:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258400/0x8f4f7840b2e41dbe lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181517.469211:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1c0258400 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:0.0:1789181517.469215:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258400/0x8f4f7840b2e41dbe lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181517.469222:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258400/0x8f4f7840b2e41dbe lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181517.469231:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9dc18a6c2b00) 00010000:00010000:0.0:1789181517.469234:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789181517.469238:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258400/0x8f4f7840b2e41dbe lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181517.469243:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258400/0x8f4f7840b2e41dbe lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181517.469254:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f800/0x8f4f7840b2e41db0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181517.469276:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f800/0x8f4f7840b2e41db0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181517.469282:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f800/0x8f4f7840b2e41db0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181517.469286:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1bfa1f800 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:0.0:1789181517.469289:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f800/0x8f4f7840b2e41db0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181517.469295:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f800/0x8f4f7840b2e41db0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181517.469304:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9dc18a6c2b00) 00010000:00010000:0.0:1789181517.469306:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789181517.469310:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f800/0x8f4f7840b2e41db0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181517.469315:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f800/0x8f4f7840b2e41db0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181517.469615:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c01b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+20:11516:x1876092488072704:12345-192.168.204.32@tcp:57:lhsmtool_posix.0 Request processed in 12330us (13147us total) trans 4294967466 rc 0/0 00000100:00100000:0.0:1789181517.469625:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 185 00000020:00080000:0.0:1789181517.469628:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1789181517.469904:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789181517.469910:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789181517.470665:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1789181517.470675:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789181517.471640:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181517.471694:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488073216 00000100:00100000:2.0:1789181517.471712:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488073216 00000100:00100000:2.0:1789181517.471773:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 50 00000100:00100000:2.0:1789181517.471783:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19928e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+20:11516:x1876092488073216:12345-192.168.204.32@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789181517.472714:0:5845:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789181517.473084:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:2.0:1789181517.473251:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258e00/0x8f4f7840b2e41dc5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181517.473314:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258e00/0x8f4f7840b2e41dc5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181517.473326:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258e00/0x8f4f7840b2e41dc5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181517.473537:0:5845:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258e00/0x8f4f7840b2e41dc5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181517.473544:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258e00/0x8f4f7840b2e41dc5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181517.473550:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258e00/0x8f4f7840b2e41dc5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181517.473612:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789181517.473731:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19928e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+22:11516:x1876092488073216:12345-192.168.204.32@tcp:35:lhsmtool_posix.0 Request processed in 1947us (2091us total) trans 4294967468 rc 0/0 00000100:00100000:2.0:1789181517.473747:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 50 00000020:00080000:2.0:1789181517.473761:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789181517.474085:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789181517.474092:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258e00/0x8f4f7840b2e41dc5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.474099:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1c0258e00 already unused, calling callback (ffffffffc152f9b0) 00010000:00010000:1.0:1789181517.474103:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258e00/0x8f4f7840b2e41dc5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.474112:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258e00/0x8f4f7840b2e41dc5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.474136:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9dc1995b7e00) 00010000:00010000:1.0:1789181517.474139:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789181517.474144:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258e00/0x8f4f7840b2e41dc5 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.474150:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258e00/0x8f4f7840b2e41dc5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.474167:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181517.474169:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181517.474170:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789181517.691108:0:12521:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789181517.691118:0:12521:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789181517.691161:0:12521:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:3.0:1789181517.691166:0:12521:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789181517.809293:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181517.809685:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488073472 00000100:00100000:1.0:1789181517.809705:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488073472 00000100:00100000:1.0:1789181517.809772:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 186 00000100:00100000:1.0:1789181517.809783:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c01b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+22:11526:x1876092488073472:12345-192.168.204.32@tcp:101:lfs.0 00010000:00010000:1.0:1789181517.809811:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181517.809840:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b600/0x8f4f7840b2e41dcc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f2ef expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.809963:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151a800/0x8f4f7840b2e41dd3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.809979:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151a800/0x8f4f7840b2e41dd3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.809994:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151a800/0x8f4f7840b2e41dd3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789181517.810005:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1789181517.810147:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b600/0x8f4f7840b2e41dcc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f2ef expref: 25 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.810178:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151a800/0x8f4f7840b2e41dd3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f2ef expref: 24 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.810187:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9dc1995b7800) 00010000:00010000:1.0:1789181517.810190:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789181517.810194:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc18151a800, rc 0) 00000100:00100000:1.0:1789181517.810253:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c01b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+24:11526:x1876092488073472:12345-192.168.204.32@tcp:101:lfs.0 Request processed in 472us (971us total) trans 4294967469 rc 0/0 00000100:00100000:1.0:1789181517.810259:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 186 00000100:00100000:3.0:1789181517.817514:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181517.817722:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488073600 00000100:00100000:1.0:1789181517.817733:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488073600 00000100:00100000:1.0:1789181517.817787:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 187 00000100:00100000:1.0:1789181517.817797:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6af0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+24:11526:x1876092488073600:12345-192.168.204.32@tcp:34:lfs.0 00010000:00010000:1.0:1789181517.817869:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151aa00/0x8f4f7840b2e41de1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.817886:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151aa00/0x8f4f7840b2e41de1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.817910:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151aa00/0x8f4f7840b2e41de1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.817924:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e41de8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.817931:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e41de8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.817953:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e41de8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.818170:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b400/0x8f4f7840b2e41def lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.818178:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b400/0x8f4f7840b2e41def lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.818185:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b400/0x8f4f7840b2e41def lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789181517.818227:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b400/0x8f4f7840b2e41def lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.818240:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151aa00/0x8f4f7840b2e41de1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.818246:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151aa00/0x8f4f7840b2e41de1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.818253:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151aa00/0x8f4f7840b2e41de1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.818259:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc18151aa00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:1.0:1789181517.818263:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151aa00/0x8f4f7840b2e41de1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.818270:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151aa00/0x8f4f7840b2e41de1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.818283:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9dc1995b7800) 00010000:00010000:1.0:1789181517.818293:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789181517.818299:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151aa00/0x8f4f7840b2e41de1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.818306:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151aa00/0x8f4f7840b2e41de1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.818326:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e41de8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.818438:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e41de8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.818445:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e41de8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.818450:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc18151ae00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:1.0:1789181517.818452:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e41de8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.818459:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e41de8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.818468:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9dc18a6c2400) 00010000:00010000:1.0:1789181517.818471:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789181517.818474:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e41de8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.818480:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e41de8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.818495:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b400/0x8f4f7840b2e41def lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.818509:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b400/0x8f4f7840b2e41def lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.818515:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b400/0x8f4f7840b2e41def lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.818520:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc18151b400 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:1.0:1789181517.818523:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b400/0x8f4f7840b2e41def lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.818529:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b400/0x8f4f7840b2e41def lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.818537:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9dc18a6c2700) 00010000:00010000:1.0:1789181517.818540:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789181517.818543:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b400/0x8f4f7840b2e41def lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.818547:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b400/0x8f4f7840b2e41def lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181517.818653:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6af0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+24:11526:x1876092488073600:12345-192.168.204.32@tcp:34:lfs.0 Request processed in 856us (1332us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181517.818662:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 187 00000100:00100000:3.0:1789181517.880876:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181517.881241:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488073856 00000100:00100000:1.0:1789181517.881253:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488073856 00000100:00100000:1.0:1789181517.881312:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 188 00000100:00100000:1.0:1789181517.881324:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6af2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+24:11529:x1876092488073856:12345-192.168.204.32@tcp:101:lfs.0 00010000:00010000:1.0:1789181517.881365:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181517.881415:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b400/0x8f4f7840b2e41df6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f2f6 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.881493:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e41dfd lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.881507:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e41dfd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.881519:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e41dfd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.881534:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151aa00/0x8f4f7840b2e41e04 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.881541:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151aa00/0x8f4f7840b2e41e04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.881548:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151aa00/0x8f4f7840b2e41e04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.881844:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b600/0x8f4f7840b2e41e0b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.881854:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b600/0x8f4f7840b2e41e0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.881862:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b600/0x8f4f7840b2e41e0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789181517.881871:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1789181517.881972:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e41dfd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.881989:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e41dfd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.881996:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e41dfd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.882003:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc18151ae00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:1.0:1789181517.882007:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e41dfd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.882014:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e41dfd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.882026:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9dc1995b7800) 00010000:00010000:1.0:1789181517.882028:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789181517.882033:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e41dfd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.882039:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e41dfd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.882057:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151aa00/0x8f4f7840b2e41e04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.882064:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151aa00/0x8f4f7840b2e41e04 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.882070:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151aa00/0x8f4f7840b2e41e04 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.882075:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc18151aa00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:1.0:1789181517.882084:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151aa00/0x8f4f7840b2e41e04 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.882091:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151aa00/0x8f4f7840b2e41e04 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.882098:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9dc18a6c2700) 00010000:00010000:1.0:1789181517.882101:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789181517.882103:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151aa00/0x8f4f7840b2e41e04 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.882109:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151aa00/0x8f4f7840b2e41e04 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.882149:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b400/0x8f4f7840b2e41df6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f2f6 expref: 27 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.882164:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b600/0x8f4f7840b2e41e0b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f2f6 expref: 26 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.882171:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9dc18a6c2400) 00010000:00010000:1.0:1789181517.882173:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789181517.882176:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc18151b600, rc 0) 00000100:00100000:1.0:1789181517.882238:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6af2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+26:11529:x1876092488073856:12345-192.168.204.32@tcp:101:lfs.0 Request processed in 917us (1373us total) trans 4294967470 rc 0/0 00000100:00100000:1.0:1789181517.882245:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 188 00000100:00100000:0.0:1789181517.899973:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181517.900054:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488073984 00000100:00100000:1.0:1789181517.900067:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488073984 00000100:00100000:1.0:1789181517.900133:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 189 00000100:00100000:1.0:1789181517.900145:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c071d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+26:11529:x1876092488073984:12345-192.168.204.32@tcp:54:lfs.0 00010000:00010000:1.0:1789181517.900239:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b400/0x8f4f7840b2e41e19 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.900257:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b400/0x8f4f7840b2e41e19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.900271:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b400/0x8f4f7840b2e41e19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.900299:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b400/0x8f4f7840b2e41e19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.900306:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b400/0x8f4f7840b2e41e19 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.900313:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b400/0x8f4f7840b2e41e19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.900319:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc18151b400 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:1.0:1789181517.900323:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b400/0x8f4f7840b2e41e19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.900348:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b400/0x8f4f7840b2e41e19 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.900360:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9dc18a6c2400) 00010000:00010000:1.0:1789181517.900363:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789181517.900367:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b400/0x8f4f7840b2e41e19 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.900387:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b400/0x8f4f7840b2e41e19 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181517.900472:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c071d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+26:11529:x1876092488073984:12345-192.168.204.32@tcp:54:lfs.0 Request processed in 329us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181517.900480:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 189 00000100:00100000:0.0:1789181517.904388:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181517.904476:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488074240 00000100:00100000:3.0:1789181517.904487:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488074240 00000100:00100000:3.0:1789181517.907592:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 51 00000100:00100000:3.0:1789181517.907616:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c071c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+26:11529:x1876092488074240:12345-192.168.204.32@tcp:35:lfs.0 00000100:00100000:3.0:1789181517.907883:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c071c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+27:11529:x1876092488074240:12345-192.168.204.32@tcp:35:lfs.0 Request processed in 276us (3504us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1789181517.907906:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 51 00000100:00100000:3.0:1789181517.988564:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181517.988685:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488074496 00000100:00100000:1.0:1789181517.988708:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488074496 00000100:00100000:1.0:1789181517.988772:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 190 00000100:00100000:1.0:1789181517.988783:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6af2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+27:11062:x1876092488074496:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:1.0:1789181517.988808:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181517.988837:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b400/0x8f4f7840b2e41e20 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f2fd expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.988934:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e41e27 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.988949:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b600/0x8f4f7840b2e41e0b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f2f6 expref: 28 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.988959:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e41e27 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.988994:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b600/0x8f4f7840b2e41e0b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f2f6 expref: 28 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181517.989009:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b600/0x8f4f7840b2e41e0b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f2f6 expref: 28 pid: 5844 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181517.989023:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1a7309500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1876092510089344:192.168.204.32@tcp:104: 00000100:00100000:1.0:1789181517.989131:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc08311d600 going to sleep for 11 seconds 00000100:00100000:1.0:1789181518.000927:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181518.001244:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488074624 00000100:00100000:2.0:1789181518.001254:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488074624 00010000:00010000:2.0:1789181518.001318:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b600/0x8f4f7840b2e41e0b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f2f6 expref: 29 pid: 5844 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181518.001486:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 73 00000100:00100000:2.0:1789181518.001499:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1ba76b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+29:2354:x1876092488074624:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789181518.001516:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789181518.001524:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b600/0x8f4f7840b2e41e0b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f2f6 expref: 29 pid: 5844 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.001538:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b600/0x8f4f7840b2e41e0b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f2f6 expref: 29 pid: 5844 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.001563:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9dc18a6c2400) 00010000:00010000:2.0:1789181518.001569:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e41e27 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.001579:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e41e27 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.001587:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e41e27 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.001609:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789181518.001663:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1ba76b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+29:2354:x1876092488074624:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 167us (747us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181518.001671:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 73 00010000:00010000:3.0:1789181518.001687:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b600/0x8f4f7840b2e41e0b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f2f6 expref: 29 pid: 5844 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181518.001725:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1a7309500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1876092510089344:192.168.204.32@tcp:104: 00010000:00010000:3.0:1789181518.001752:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e41e27 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181518.001763:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e41e27 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181518.001769:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e41e27 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789181518.001793:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00000100:00080000:0.0:1789181518.001898:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789181518.001959:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b400/0x8f4f7840b2e41e20 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f2fd expref: 29 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181518.001976:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e41e27 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f2fd expref: 28 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181518.001984:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9dc18a6c2400) 00010000:00010000:3.0:1789181518.001987:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789181518.001990:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc18151ae00, rc 0) 00000100:00100000:3.0:1789181518.002168:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6af2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+28:11062:x1876092488074496:12345-192.168.204.32@tcp:101:bash.0 Request processed in 13387us (13614us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1789181518.002189:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 190 00000100:00100000:1.0:1789181518.009036:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181518.009157:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488074880 00000100:00100000:2.0:1789181518.009167:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488074880 00000100:00100000:2.0:1789181518.009220:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 191 00000100:00100000:2.0:1789181518.009230:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1baadc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+28:11062:x1876092488074880:12345-192.168.204.32@tcp:36:bash.0 00010000:00010000:2.0:1789181518.009585:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259200/0x8f4f7840b2e41e35 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.009602:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259200/0x8f4f7840b2e41e35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.009613:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259200/0x8f4f7840b2e41e35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789181518.009664:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:2.0:1789181518.009700:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004b480e0d reply state 0000000079bf2427 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259200/0x8f4f7840b2e41e35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181518.009709:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1789181518.009758:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:2.0:1789181518.009876:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1baadc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+32:11062:x1876092488074880:12345-192.168.204.32@tcp:36:bash.0 Request processed in 647us (853us total) trans 4294967475 rc 0/0 00000100:00100000:2.0:1789181518.009883:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 191 00000020:00080000:2.0:1789181518.009888:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1789181518.017486:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00010000:00010000:3.0:1789181518.017609:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259200/0x8f4f7840b2e41e35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181518.017623:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259200/0x8f4f7840b2e41e35 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181518.017632:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259200/0x8f4f7840b2e41e35 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181518.017638:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1c0259200 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:3.0:1789181518.017644:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259200/0x8f4f7840b2e41e35 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181518.017652:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259200/0x8f4f7840b2e41e35 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181518.017660:0:6887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488075008 00010000:00010000:3.0:1789181518.017669:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9dc18a6c2400) 00000100:00100000:2.0:1789181518.017671:0:6887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488075008 00010000:00010000:3.0:1789181518.017675:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181518.017683:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259200/0x8f4f7840b2e41e35 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181518.017699:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259200/0x8f4f7840b2e41e35 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181518.017737:0:6887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 192 00000100:00100000:2.0:1789181518.017748:0:6887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1988c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+31:11062:x1876092488075008:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:2.0:1789181518.017773:0:6887:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181518.017791:0:6887:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258000/0x8f4f7840b2e41e3c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f304 expref: -99 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.017861:0:6887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258000/0x8f4f7840b2e41e3c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f304 expref: 32 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.017875:0:6887:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258000/0x8f4f7840b2e41e3c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f304 expref: 32 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.017893:0:6887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9dc18a6c2400) 00010000:00010000:2.0:1789181518.017896:0:6887:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789181518.017898:0:6887:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1c0258000, rc 0) 00000100:00100000:2.0:1789181518.017963:0:6887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1988c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+32:11062:x1876092488075008:12345-192.168.204.32@tcp:101:bash.0 Request processed in 217us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181518.017971:0:6887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 192 00000100:00100000:3.0:1789181518.023257:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181518.023507:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488075136 00000100:00100000:2.0:1789181518.023518:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488075136 00000100:00100000:2.0:1789181518.023581:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 59 00000100:00100000:2.0:1789181518.023700:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1a7309500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+7:11062:x1876092488075136:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:2.0:1789181518.023721:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181518.023743:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000019f80116/0x8f4f7840b2e41e43 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f30b expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789181518.023771:0:6693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aa4be4d, atime: 0x6aa4be4b, ctime: 0x6aa4be4d, blocks: 0xb 00010000:00010000:2.0:1789181518.023795:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=410s v=(0 0) 00010000:00010000:2.0:1789181518.023800:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789181518.023809:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019f80116/0x8f4f7840b2e41e43 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f30b expref: 8 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.023852:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000019f80116/0x8f4f7840b2e41e43 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f30b expref: 8 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.023867:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1c0259a00, rc 0) 00000100:00100000:2.0:1789181518.023935:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1a7309500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+8:11062:x1876092488075136:12345-192.168.204.32@tcp:101:bash.0 Request processed in 345us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181518.023943:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 59 00000100:00100000:1.0:1789181518.030651:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181518.030857:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488075264 00000100:00100000:0.0:1789181518.030869:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488075264 00002000:00010000:0.0:1789181518.030913:0:6698:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:0.0:1789181518.030918:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9dc1baadd180 with x1876092488075264 ext(0->18446744073709551615) 00002000:00010000:0.0:1789181518.030931:0:6698:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9dc1baadd180. 00000100:00100000:0.0:1789181518.030972:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 6 00000100:00100000:0.0:1789181518.030984:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1baadd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+8:2354:x1876092488075264:12345-192.168.204.32@tcp:10:bash.0 00002000:00010000:0.0:1789181518.031260:0:6698:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1789181518.031264:0:6698:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1789181517 -> 1789181519 00002000:00010000:0.0:1789181518.031267:0:6698:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1789181515 -> 1789181515 00002000:00010000:0.0:1789181518.031270:0:6698:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789181517 -> 1789181519 00002000:00010000:0.0:1789181518.031272:0:6698:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1789181518.031375:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1baadd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+9:2354:x1876092488075264:12345-192.168.204.32@tcp:10:bash.0 Request processed in 392us (734us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1789181518.031383:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 6 00002000:00010000:0.0:1789181518.031387:0:6698:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:0.0:1789181518.031390:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9dc1baadd180 with x1876092488075264 ext(0->18446744073709551615) 00002000:00010000:0.0:1789181518.031395:0:6698:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9dc1baadd180. 00000100:00100000:0.0:1789181518.141518:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181518.141642:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488075392 00000100:00100000:2.0:1789181518.141653:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488075392 00000100:00100000:2.0:1789181518.141723:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 193 00000100:00100000:2.0:1789181518.141736:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1988c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+32:11543:x1876092488075392:12345-192.168.204.32@tcp:34:lfs.0 00010000:00010000:2.0:1789181518.141821:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259800/0x8f4f7840b2e41e4a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.141838:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259800/0x8f4f7840b2e41e4a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.141851:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259800/0x8f4f7840b2e41e4a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.141866:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258200/0x8f4f7840b2e41e51 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.141872:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258200/0x8f4f7840b2e41e51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.141878:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258200/0x8f4f7840b2e41e51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.142139:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258600/0x8f4f7840b2e41e58 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.142148:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258600/0x8f4f7840b2e41e58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.142156:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258600/0x8f4f7840b2e41e58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789181518.142195:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258600/0x8f4f7840b2e41e58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.142205:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259800/0x8f4f7840b2e41e4a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.142211:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259800/0x8f4f7840b2e41e4a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.142218:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259800/0x8f4f7840b2e41e4a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.142223:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1c0259800 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:2.0:1789181518.142228:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259800/0x8f4f7840b2e41e4a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.142236:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259800/0x8f4f7840b2e41e4a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.142247:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9dc1995b7800) 00010000:00010000:2.0:1789181518.142249:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789181518.142254:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259800/0x8f4f7840b2e41e4a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.142266:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259800/0x8f4f7840b2e41e4a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.142279:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258200/0x8f4f7840b2e41e51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.142285:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258200/0x8f4f7840b2e41e51 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.142291:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258200/0x8f4f7840b2e41e51 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.142297:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1c0258200 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:2.0:1789181518.142300:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258200/0x8f4f7840b2e41e51 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.142306:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258200/0x8f4f7840b2e41e51 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.142314:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9dc1995b7500) 00010000:00010000:2.0:1789181518.142316:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789181518.142319:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258200/0x8f4f7840b2e41e51 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.142324:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258200/0x8f4f7840b2e41e51 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.142767:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258600/0x8f4f7840b2e41e58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.142773:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258600/0x8f4f7840b2e41e58 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.142785:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258600/0x8f4f7840b2e41e58 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.142790:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1c0258600 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:2.0:1789181518.142792:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258600/0x8f4f7840b2e41e58 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.142798:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258600/0x8f4f7840b2e41e58 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.142981:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9dc18a6c2400) 00010000:00010000:2.0:1789181518.142985:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789181518.142990:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258600/0x8f4f7840b2e41e58 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.142996:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258600/0x8f4f7840b2e41e58 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181518.143073:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1988c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+32:11543:x1876092488075392:12345-192.168.204.32@tcp:34:lfs.0 Request processed in 1337us (1563us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181518.143081:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 193 00000100:00100000:3.0:1789181518.197834:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181518.198000:0:6887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488075648 00000100:00100000:2.0:1789181518.198011:0:6887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488075648 00000100:00100000:2.0:1789181518.198091:0:6887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 194 00000100:00100000:2.0:1789181518.198103:0:6887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c36ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+32:11546:x1876092488075648:12345-192.168.204.32@tcp:101:lfs.0 00010000:00010000:2.0:1789181518.198134:0:6887:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181518.198157:0:6887:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258600/0x8f4f7840b2e41e5f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f312 expref: -99 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.198246:0:6887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258200/0x8f4f7840b2e41e66 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.198261:0:6887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258200/0x8f4f7840b2e41e66 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.198273:0:6887:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258200/0x8f4f7840b2e41e66 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.198286:0:6887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259800/0x8f4f7840b2e41e6d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.198292:0:6887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259800/0x8f4f7840b2e41e6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.198299:0:6887:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259800/0x8f4f7840b2e41e6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.198596:0:6887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259600/0x8f4f7840b2e41e74 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.198607:0:6887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259600/0x8f4f7840b2e41e74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.198614:0:6887:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259600/0x8f4f7840b2e41e74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789181518.198624:0:6887:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1789181518.198734:0:6887:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258200/0x8f4f7840b2e41e66 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.198742:0:6887:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258200/0x8f4f7840b2e41e66 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.198756:0:6887:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258200/0x8f4f7840b2e41e66 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.198764:0:6887:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1c0258200 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:2.0:1789181518.198768:0:6887:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258200/0x8f4f7840b2e41e66 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.198776:0:6887:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258200/0x8f4f7840b2e41e66 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.198789:0:6887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9dc1995b7800) 00010000:00010000:2.0:1789181518.198792:0:6887:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789181518.198797:0:6887:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258200/0x8f4f7840b2e41e66 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.198804:0:6887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258200/0x8f4f7840b2e41e66 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.198817:0:6887:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259800/0x8f4f7840b2e41e6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.198823:0:6887:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259800/0x8f4f7840b2e41e6d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.198830:0:6887:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259800/0x8f4f7840b2e41e6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.198835:0:6887:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1c0259800 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:2.0:1789181518.198838:0:6887:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259800/0x8f4f7840b2e41e6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.198855:0:6887:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259800/0x8f4f7840b2e41e6d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.198864:0:6887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9dc1995b7500) 00010000:00010000:2.0:1789181518.198866:0:6887:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789181518.198869:0:6887:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259800/0x8f4f7840b2e41e6d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.198876:0:6887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259800/0x8f4f7840b2e41e6d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.198918:0:6887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258600/0x8f4f7840b2e41e5f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f312 expref: 35 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.198933:0:6887:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259600/0x8f4f7840b2e41e74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f312 expref: 34 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.198940:0:6887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9dc18a6c2400) 00010000:00010000:2.0:1789181518.198942:0:6887:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789181518.198945:0:6887:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1c0259600, rc 0) 00000100:00100000:2.0:1789181518.199014:0:6887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c36ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+34:11546:x1876092488075648:12345-192.168.204.32@tcp:101:lfs.0 Request processed in 913us (1189us total) trans 4294967476 rc 0/0 00000100:00100000:2.0:1789181518.199021:0:6887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 194 00000100:00100000:1.0:1789181518.211248:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181518.211392:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488075776 00000100:00100000:0.0:1789181518.211404:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488075776 00000100:00100000:0.0:1789181518.211469:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 195 00000100:00100000:0.0:1789181518.211480:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6c09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+34:11546:x1876092488075776:12345-192.168.204.32@tcp:54:lfs.0 00010000:00010000:0.0:1789181518.211550:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890c00/0x8f4f7840b2e41e82 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181518.211568:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e41e27 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f2fd expref: 34 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181518.211586:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890c00/0x8f4f7840b2e41e82 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181518.211622:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e41e27 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f2fd expref: 34 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181518.211635:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e41e27 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f2fd expref: 34 pid: 5844 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181518.211648:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b66f7100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1876092510089472:192.168.204.32@tcp:104: 00000100:00100000:0.0:1789181518.211759:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1ba4b96c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789181518.216429:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181518.216678:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488076032 00000100:00100000:2.0:1789181518.216706:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488076032 00000100:00100000:2.0:1789181518.216766:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 52 00000100:00100000:2.0:1789181518.216777:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b66f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+35:5591:x1876092488076032:12345-192.168.204.32@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789181518.217446:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b66f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+36:5591:x1876092488076032:12345-192.168.204.32@tcp:35:ldlm_bl.0 Request processed in 668us (1024us total) trans 4294967477 rc 0/0 00000100:00100000:2.0:1789181518.217455:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 52 00000100:00100000:3.0:1789181518.217666:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b66f7100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1876092510089472:192.168.204.32@tcp:104: 00010000:00010000:3.0:1789181518.217707:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890c00/0x8f4f7840b2e41e82 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181518.220976:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181518.221313:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488076160 00000100:00100000:0.0:1789181518.221324:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488076160 00010000:00010000:0.0:1789181518.221449:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e41e27 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f2fd expref: 36 pid: 5844 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181518.221493:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 74 00000100:00100000:0.0:1789181518.221503:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c36c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+36:2354:x1876092488076160:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789181518.221519:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789181518.221525:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e41e27 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f2fd expref: 36 pid: 5844 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181518.221538:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e41e27 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f2fd expref: 36 pid: 5844 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181518.221581:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e41e27 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f2fd expref: 36 pid: 5844 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181518.221602:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9dc18a6c2400) 00010000:00010000:0.0:1789181518.221608:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890c00/0x8f4f7840b2e41e82 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181518.221618:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890c00/0x8f4f7840b2e41e82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181518.221625:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890c00/0x8f4f7840b2e41e82 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181518.221716:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789181518.221778:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c36c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+35:2354:x1876092488076160:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 277us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181518.221786:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 74 00010000:00010000:1.0:1789181518.223683:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890c00/0x8f4f7840b2e41e82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181518.223708:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890c00/0x8f4f7840b2e41e82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181518.223799:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890c00/0x8f4f7840b2e41e82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181518.223808:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890c00/0x8f4f7840b2e41e82 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181518.223815:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890c00/0x8f4f7840b2e41e82 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181518.223821:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc189890c00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:1.0:1789181518.223825:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890c00/0x8f4f7840b2e41e82 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181518.223834:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890c00/0x8f4f7840b2e41e82 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181518.223850:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9dc18a6c2400) 00010000:00010000:1.0:1789181518.223853:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789181518.223857:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890c00/0x8f4f7840b2e41e82 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181518.223958:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890c00/0x8f4f7840b2e41e82 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181518.224284:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6c09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+34:11546:x1876092488075776:12345-192.168.204.32@tcp:54:lfs.0 Request processed in 12802us (13041us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181518.224294:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 195 00000100:00100000:3.0:1789181518.231259:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181518.231327:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488076416 00000100:00100000:1.0:1789181518.231362:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488076416 00000100:00100000:1.0:1789181518.231416:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 53 00000100:00100000:1.0:1789181518.231426:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c36df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+34:11546:x1876092488076416:12345-192.168.204.32@tcp:35:lfs.0 00000100:00100000:1.0:1789181518.232425:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c36df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+35:11546:x1876092488076416:12345-192.168.204.32@tcp:35:lfs.0 Request processed in 996us (1173us total) trans 4294967478 rc 0/0 00000100:00100000:1.0:1789181518.232435:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 53 00000100:00100000:3.0:1789181518.335212:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181518.335311:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488076672 00000100:00100000:0.0:1789181518.335321:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488076672 00000100:00100000:0.0:1789181518.335403:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 196 00000100:00100000:0.0:1789181518.335413:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c36f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+35:11557:x1876092488076672:12345-192.168.204.32@tcp:101:cat.0 00010000:00010000:0.0:1789181518.335436:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181518.335455:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890400/0x8f4f7840b2e41e89 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f319 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181518.335526:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891a00/0x8f4f7840b2e41e90 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181518.335559:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891a00/0x8f4f7840b2e41e90 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181518.335570:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891a00/0x8f4f7840b2e41e90 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181518.335587:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890600/0x8f4f7840b2e41e97 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181518.335595:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890600/0x8f4f7840b2e41e97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181518.335602:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890600/0x8f4f7840b2e41e97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181518.335874:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891000/0x8f4f7840b2e41e9e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181518.335898:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891000/0x8f4f7840b2e41e9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181518.335906:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891000/0x8f4f7840b2e41e9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789181518.335917:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:0.0:1789181518.335998:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891a00/0x8f4f7840b2e41e90 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181518.336005:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891a00/0x8f4f7840b2e41e90 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181518.336012:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891a00/0x8f4f7840b2e41e90 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181518.336024:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc189891a00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:0.0:1789181518.336029:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891a00/0x8f4f7840b2e41e90 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181518.336036:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891a00/0x8f4f7840b2e41e90 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181518.336050:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9dc1995b7800) 00010000:00010000:0.0:1789181518.336053:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789181518.336057:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891a00/0x8f4f7840b2e41e90 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181518.336063:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891a00/0x8f4f7840b2e41e90 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181518.336075:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890600/0x8f4f7840b2e41e97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181518.336081:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890600/0x8f4f7840b2e41e97 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181518.336087:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890600/0x8f4f7840b2e41e97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181518.336091:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc189890600 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:0.0:1789181518.336093:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890600/0x8f4f7840b2e41e97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181518.336099:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890600/0x8f4f7840b2e41e97 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181518.336116:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9dc18553af00) 00010000:00010000:0.0:1789181518.336118:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789181518.336121:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890600/0x8f4f7840b2e41e97 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181518.336127:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890600/0x8f4f7840b2e41e97 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181518.336167:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890400/0x8f4f7840b2e41e89 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f319 expref: 38 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181518.336180:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891000/0x8f4f7840b2e41e9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f319 expref: 37 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181518.336188:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9dc18a6c2400) 00010000:00010000:0.0:1789181518.336190:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789181518.336192:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc189891000, rc 0) 00000100:00100000:0.0:1789181518.336255:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c36f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+37:11557:x1876092488076672:12345-192.168.204.32@tcp:101:cat.0 Request processed in 843us (1052us total) trans 4294967479 rc 0/0 00000100:00100000:0.0:1789181518.336261:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 196 00000100:00100000:2.0:1789181518.344530:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181518.344629:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488076928 00000100:00100000:0.0:1789181518.344639:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488076928 00000100:00100000:0.0:1789181518.344711:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 54 00000100:00100000:0.0:1789181518.344731:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c01b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+37:11557:x1876092488076928:12345-192.168.204.32@tcp:35:cat.0 00000100:00100000:0.0:1789181518.344982:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c01b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+38:11557:x1876092488076928:12345-192.168.204.32@tcp:35:cat.0 Request processed in 262us (462us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1789181518.344990:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 54 00000100:00100000:1.0:1789181518.368579:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181518.368673:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488077184 00000100:00100000:2.0:1789181518.368698:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488077184 00000100:00100000:2.0:1789181518.368765:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 197 00000100:00100000:2.0:1789181518.368776:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6c09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+38:11558:x1876092488077184:12345-192.168.204.32@tcp:36:rm.0 00010000:00010000:2.0:1789181518.368830:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789181518.368858:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891000/0x8f4f7840b2e41e9e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f319 expref: 38 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.368892:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259600/0x8f4f7840b2e41e74 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f312 expref: 37 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.368906:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258000/0x8f4f7840b2e41e3c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f304 expref: 36 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.368916:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9dc18a6c2400) 00010000:00010000:2.0:1789181518.368926:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789181518.368946:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258200/0x8f4f7840b2e41eac lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.368960:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258200/0x8f4f7840b2e41eac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.368969:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258200/0x8f4f7840b2e41eac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.369001:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258a00/0x8f4f7840b2e41eb3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.369008:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258a00/0x8f4f7840b2e41eb3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.369015:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258a00/0x8f4f7840b2e41eb3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.369597:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259e00/0x8f4f7840b2e41eba lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.369608:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259e00/0x8f4f7840b2e41eba lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.369616:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259e00/0x8f4f7840b2e41eba lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789181518.370602:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:2.0:1789181518.370614:0:5842:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 410627282860ns, next at 411627280484ns, rc = 0 00010000:00010000:2.0:1789181518.370675:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259c00/0x8f4f7840b2e41ec1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.370699:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259c00/0x8f4f7840b2e41ec1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.370710:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259c00/0x8f4f7840b2e41ec1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.370875:0:5842:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259c00/0x8f4f7840b2e41ec1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.370966:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259c00/0x8f4f7840b2e41ec1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.370972:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259c00/0x8f4f7840b2e41ec1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.371030:0:5842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789181518.371060:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259e00/0x8f4f7840b2e41eba lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.371066:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259e00/0x8f4f7840b2e41eba lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.371073:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259e00/0x8f4f7840b2e41eba lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.371078:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1c0259e00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:2.0:1789181518.371083:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259e00/0x8f4f7840b2e41eba lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.371092:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259e00/0x8f4f7840b2e41eba lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.371104:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9dc1995b7100) 00010000:00010000:2.0:1789181518.371165:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789181518.371171:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259e00/0x8f4f7840b2e41eba lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.371177:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259e00/0x8f4f7840b2e41eba lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.371196:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258200/0x8f4f7840b2e41eac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.371207:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258200/0x8f4f7840b2e41eac lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.371214:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258200/0x8f4f7840b2e41eac lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.371219:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1c0258200 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:2.0:1789181518.371222:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258200/0x8f4f7840b2e41eac lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.371229:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258200/0x8f4f7840b2e41eac lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.371237:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9dc1995b7800) 00010000:00010000:2.0:1789181518.371249:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789181518.371252:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258200/0x8f4f7840b2e41eac lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.371257:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258200/0x8f4f7840b2e41eac lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789181518.371267:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000a728097 reply state 0000000042975e16 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258a00/0x8f4f7840b2e41eb3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181518.371277:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789181518.371566:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6c09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+37:11558:x1876092488077184:12345-192.168.204.32@tcp:36:rm.0 Request processed in 2788us (2992us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1789181518.371575:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 197 00010000:00010000:3.0:1789181518.372989:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789181518.373000:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259c00/0x8f4f7840b2e41ec1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181518.373009:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1c0259c00 already unused, calling callback (ffffffffc152f9b0) 00010000:00010000:3.0:1789181518.373013:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259c00/0x8f4f7840b2e41ec1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181518.373022:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259c00/0x8f4f7840b2e41ec1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181518.373036:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9dc1995b7100) 00010000:00010000:3.0:1789181518.373039:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789181518.373043:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259c00/0x8f4f7840b2e41ec1 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181518.373049:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259c00/0x8f4f7840b2e41ec1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181518.373207:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181518.373209:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181518.373211:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181518.374626:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258a00/0x8f4f7840b2e41eb3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181518.374641:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258a00/0x8f4f7840b2e41eb3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181518.374649:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258a00/0x8f4f7840b2e41eb3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181518.374655:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1c0258a00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:1.0:1789181518.374660:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258a00/0x8f4f7840b2e41eb3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181518.374667:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258a00/0x8f4f7840b2e41eb3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181518.374706:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9dc1995b7500) 00010000:00010000:1.0:1789181518.374709:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789181518.374713:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258a00/0x8f4f7840b2e41eb3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181518.374720:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258a00/0x8f4f7840b2e41eb3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181518.399938:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181518.440745:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181518.441188:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488077440 00000100:00100000:0.0:1789181518.441199:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488077440 00000100:00100000:0.0:1789181518.441266:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 198 00000100:00100000:0.0:1789181518.441277:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6c09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+36:11564:x1876092488077440:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:0.0:1789181518.441301:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181518.441320:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890600/0x8f4f7840b2e41ec8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f320 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181518.441473:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891a00/0x8f4f7840b2e41ecf lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181518.441487:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891a00/0x8f4f7840b2e41ecf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181518.441497:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891a00/0x8f4f7840b2e41ecf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181518.441511:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891400/0x8f4f7840b2e41ed6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181518.441517:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891400/0x8f4f7840b2e41ed6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181518.441523:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891400/0x8f4f7840b2e41ed6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789181518.442866:0:5844:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:0.0:1789181518.443816:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891c00/0x8f4f7840b2e41edd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181518.443833:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891c00/0x8f4f7840b2e41edd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181518.443854:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891c00/0x8f4f7840b2e41edd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181518.443903:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891a00/0x8f4f7840b2e41ecf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181518.443911:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891a00/0x8f4f7840b2e41ecf lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181518.443917:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891a00/0x8f4f7840b2e41ecf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181518.443923:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc189891a00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:0.0:1789181518.443927:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891a00/0x8f4f7840b2e41ecf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181518.443935:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891a00/0x8f4f7840b2e41ecf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181518.443947:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9dc1995b7800) 00010000:00010000:0.0:1789181518.443950:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789181518.443954:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891a00/0x8f4f7840b2e41ecf lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181518.443960:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891a00/0x8f4f7840b2e41ecf lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789181518.443974:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f5953b66 reply state 000000003472f92d transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891400/0x8f4f7840b2e41ed6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181518.443984:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789181518.444025:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890600/0x8f4f7840b2e41ec8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f320 expref: 39 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181518.444040:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891c00/0x8f4f7840b2e41edd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f320 expref: 38 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181518.444048:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9dc18553a500) 00010000:00010000:0.0:1789181518.444050:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789181518.444053:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc189891c00, rc 0) 00000100:00100000:0.0:1789181518.444143:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6c09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+39:11564:x1876092488077440:12345-192.168.204.32@tcp:101:bash.0 Request processed in 2867us (3412us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1789181518.444151:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 198 00010000:00010000:1.0:1789181518.448817:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891400/0x8f4f7840b2e41ed6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181518.448837:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891400/0x8f4f7840b2e41ed6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181518.448846:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891400/0x8f4f7840b2e41ed6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181518.448852:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc189891400 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:1.0:1789181518.448858:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891400/0x8f4f7840b2e41ed6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181518.448865:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891400/0x8f4f7840b2e41ed6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181518.448960:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9dc18553af00) 00010000:00010000:1.0:1789181518.448964:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789181518.448970:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891400/0x8f4f7840b2e41ed6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181518.448995:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891400/0x8f4f7840b2e41ed6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181518.454403:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181518.454480:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488077568 00000100:00100000:0.0:1789181518.454491:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488077568 00000100:00080000:3.0:1789181518.454565:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789181518.454565:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 60 00000100:00100000:0.0:1789181518.454577:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6c08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+7:2354:x1876092488077568:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:0.0:1789181518.454595:0:6692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181518.454614:0:6692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001bd9c344/0x8f4f7840b2e41eeb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f327 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789181518.454639:0:6692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789181518.454656:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=410s v=(0 0) 00010000:00010000:0.0:1789181518.454660:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789181518.454669:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001bd9c344/0x8f4f7840b2e41eeb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f327 expref: 8 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181518.454696:0:6692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001bd9c344/0x8f4f7840b2e41eeb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f327 expref: 8 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181518.454722:0:6692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc189890600, rc 0) 00000100:00100000:0.0:1789181518.454783:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6c08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+8:2354:x1876092488077568:12345-192.168.204.32@tcp:101:bash.0 Request processed in 209us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181518.454791:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 60 00000100:00100000:3.0:1789181518.467451:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181518.467652:0:6894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488077696 00000100:00100000:2.0:1789181518.467662:0:6894:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488077696 00000100:00100000:2.0:1789181518.467743:0:6894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 61 00000100:00100000:2.0:1789181518.467753:0:6894:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1825a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+8:11564:x1876092488077696:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:2.0:1789181518.467773:0:6894:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181518.467791:0:6894:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000091461032/0x8f4f7840b2e41ef2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f32e expref: -99 pid: 6894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.467824:0:6894:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001bd9c344/0x8f4f7840b2e41eeb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f327 expref: 9 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.467832:0:6894:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789181518.467837:0:6894:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789181518.467842:0:6894:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000091461032/0x8f4f7840b2e41ef2 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f32e expref: 9 pid: 6894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.467872:0:6894:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001bd9c344/0x8f4f7840b2e41eeb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f327 expref: 9 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.467899:0:6894:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001bd9c344/0x8f4f7840b2e41eeb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f327 expref: 9 pid: 6692 timeout: 510 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181518.467913:0:6894:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfb2ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:6894:1876092510089600:192.168.204.32@tcp:104: 00000100:00100000:2.0:1789181518.467998:0:6894:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1879a6180 going to sleep for 11 seconds 00000100:00100000:2.0:1789181518.472084:0:6894:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfb2ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:6894:1876092510089600:192.168.204.32@tcp:104: 00010000:00010000:2.0:1789181518.472123:0:6894:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000091461032/0x8f4f7840b2e41ef2 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f32e expref: 9 pid: 6894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.472169:0:6894:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1c0259e00, rc 0) 00000100:00100000:2.0:1789181518.472710:0:6894:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1825a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+9:11564:x1876092488077696:12345-192.168.204.32@tcp:101:bash.0 Request processed in 4489us (4799us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181518.472718:0:6894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 61 00000100:00100000:1.0:1789181518.487757:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181518.490217:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488077824 00000100:00100000:2.0:1789181518.490232:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488077824 00010000:00010000:2.0:1789181518.490287:0:6707:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001bd9c344/0x8f4f7840b2e41eeb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f327 expref: 9 pid: 6692 timeout: 510 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181518.490364:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 75 00000100:00100000:2.0:1789181518.490374:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19619c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+9:2354:x1876092488077824:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789181518.490389:0:6707:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789181518.490410:0:6707:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001bd9c344/0x8f4f7840b2e41eeb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f327 expref: 9 pid: 6692 timeout: 510 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.490422:0:6707:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001bd9c344/0x8f4f7840b2e41eeb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f327 expref: 9 pid: 6692 timeout: 510 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.490443:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001bd9c344/0x8f4f7840b2e41eeb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f327 expref: 9 pid: 6692 timeout: 510 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.490458:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789181518.490462:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789181518.490469:0:6707:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000091461032/0x8f4f7840b2e41ef2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f32e expref: 8 pid: 6894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.490493:0:6707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000091461032/0x8f4f7840b2e41ef2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f32e expref: 8 pid: 6894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.490532:0:6707:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000091461032/0x8f4f7840b2e41ef2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f32e expref: 8 pid: 6894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181518.490547:0:6707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfb2ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6707:1876092510089728:192.168.204.32@tcp:105: 00000100:00100000:2.0:1789181518.490627:0:6707:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1879a6180 going to sleep for 11 seconds 00000100:00100000:1.0:1789181518.502124:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181518.502231:0:6707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfb2ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6707:1876092510089728:192.168.204.32@tcp:105: 00010000:00010000:2.0:1789181518.502270:0:6707:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789181518.502357:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19619c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+8:2354:x1876092488077824:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 11957us (14583us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181518.502370:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 75 00000100:00100000:0.0:1789181518.503153:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488078080 00000100:00100000:0.0:1789181518.503161:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488078080 00000100:00100000:0.0:1789181518.503220:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 55 00000100:00100000:0.0:1789181518.503230:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6c09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+38:11564:x1876092488078080:12345-192.168.204.32@tcp:35:bash.0 00000100:00100000:0.0:1789181518.503596:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6c09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+39:11564:x1876092488078080:12345-192.168.204.32@tcp:35:bash.0 Request processed in 367us (1481us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1789181518.503603:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 55 00000040:00080000:2.0:1789181518.527226:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789181518.527235:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789181518.527478:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1789181518.527486:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789181518.693091:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181518.693191:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488078208 00000100:00100000:3.0:1789181518.693201:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488078208 00000100:00100000:3.0:1789181518.693267:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 199 00000100:00100000:3.0:1789181518.693287:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6c0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+39:11580:x1876092488078208:12345-192.168.204.32@tcp:101:lfs.0 00010000:00010000:3.0:1789181518.693311:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181518.693353:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e41ef9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f335 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181518.693422:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e800/0x8f4f7840b2e41f00 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181518.693437:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e800/0x8f4f7840b2e41f00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181518.693448:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e800/0x8f4f7840b2e41f00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789181518.693481:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1789181518.693485:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789181518.693500:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e800/0x8f4f7840b2e41f00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181518.693522:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e41ef9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f335 expref: 41 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181518.693539:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e800/0x8f4f7840b2e41f00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f335 expref: 40 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181518.693547:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9dc1995b7800) 00010000:00010000:3.0:1789181518.693549:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789181518.693553:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1bfa1e800, rc 0) 00000100:00100000:3.0:1789181518.693611:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6c0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+40:11580:x1876092488078208:12345-192.168.204.32@tcp:101:lfs.0 Request processed in 327us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181518.693626:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 199 00000100:00100000:1.0:1789181518.699263:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181518.704528:0:6887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488078464 00000100:00100000:2.0:1789181518.704543:0:6887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488078464 00000100:00100000:2.0:1789181518.704622:0:6887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 200 00000100:00100000:2.0:1789181518.704634:0:6887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6c0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+40:11580:x1876092488078464:12345-192.168.204.32@tcp:101:lfs.0 00010000:00010000:2.0:1789181518.704654:0:6887:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181518.704672:0:6887:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258000/0x8f4f7840b2e41f07 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f33c expref: -99 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.705365:0:6887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259600/0x8f4f7840b2e41f0e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.705380:0:6887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259600/0x8f4f7840b2e41f0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.705393:0:6887:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259600/0x8f4f7840b2e41f0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789181518.705404:0:6887:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1789181518.705536:0:6887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258000/0x8f4f7840b2e41f07 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f33c expref: 43 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.705556:0:6887:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259600/0x8f4f7840b2e41f0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f33c expref: 42 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.705563:0:6887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9dc18553a500) 00010000:00010000:2.0:1789181518.705566:0:6887:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789181518.705569:0:6887:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1c0259600, rc 0) 00000100:00100000:2.0:1789181518.705635:0:6887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6c0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+42:11580:x1876092488078464:12345-192.168.204.32@tcp:101:lfs.0 Request processed in 1004us (6383us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1789181518.705642:0:6887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 200 00000100:00100000:1.0:1789181518.715957:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181518.716052:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181518.719257:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488078848 00000100:00100000:3.0:1789181518.719273:0:8456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488078848 00000100:00100000:3.0:1789181518.719356:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 15 00000100:00100000:3.0:1789181518.719367:0:8456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6c0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5971a429-48ca-4c07-88a3-fa58102a53bc+42:2352:x1876092488078848:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789181518.719382:0:8456:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789181518.719404:0:8456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259600/0x8f4f7840b2e41f0e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f33c expref: 42 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181518.719424:0:8456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9dc18553a500) 00010000:00010000:3.0:1789181518.719429:0:8456:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789181518.719489:0:8456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6c0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5971a429-48ca-4c07-88a3-fa58102a53bc+41:2352:x1876092488078848:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 124us (3436us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181518.719496:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 15 00000100:00100000:2.0:1789181518.720191:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488078720 00000100:00100000:2.0:1789181518.720198:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488078720 00000100:00100000:2.0:1789181518.720237:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 201 00000100:00100000:2.0:1789181518.720246:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6c08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+41:11580:x1876092488078720:12345-192.168.204.32@tcp:101:lfs.0 00010000:00010000:2.0:1789181518.720264:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181518.720294:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258000/0x8f4f7840b2e41f1c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f343 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.720402:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258200/0x8f4f7840b2e41f23 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.720416:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258200/0x8f4f7840b2e41f23 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.720426:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258200/0x8f4f7840b2e41f23 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789181518.720436:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1789181518.720556:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258000/0x8f4f7840b2e41f1c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f343 expref: 44 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.720572:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258200/0x8f4f7840b2e41f23 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f343 expref: 43 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.720580:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9dc18553a500) 00010000:00010000:2.0:1789181518.720583:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789181518.720586:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1c0258200, rc 0) 00000100:00100000:2.0:1789181518.720637:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6c08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+43:11580:x1876092488078720:12345-192.168.204.32@tcp:101:lfs.0 Request processed in 392us (4689us total) trans 4294967485 rc 0/0 00000100:00100000:2.0:1789181518.720644:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 201 00000100:00100000:1.0:1789181518.731756:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181518.731898:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488078976 00000100:00100000:0.0:1789181518.731909:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488078976 00000100:00100000:0.0:1789181518.731966:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 62 00000100:00100000:0.0:1789181518.731977:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6c0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+8:2353:x1876092488078976:12345-192.168.204.32@tcp:1:lfs.0 00010000:00010000:0.0:1789181518.732016:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008301596c/0x8f4f7840b2e41f31 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181518.732047:0:6692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000091461032/0x8f4f7840b2e41ef2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f32e expref: 8 pid: 6894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181518.732056:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789181518.732061:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789181518.732066:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008301596c/0x8f4f7840b2e41f31 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181518.732116:0:6692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000091461032/0x8f4f7840b2e41ef2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f32e expref: 8 pid: 6894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181518.732131:0:6692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000091461032/0x8f4f7840b2e41ef2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f32e expref: 8 pid: 6894 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181518.732145:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b66f7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6692:1876092510089856:192.168.204.32@tcp:104: 00000100:00100000:0.0:1789181518.732255:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1ba4b9cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789181518.737405:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b66f7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6692:1876092510089856:192.168.204.32@tcp:104: 00010000:00010000:0.0:1789181518.737434:0:6692:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008301596c/0x8f4f7840b2e41f31 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181518.748118:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181518.749140:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488079104 00000100:00100000:2.0:1789181518.749151:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488079104 00002000:00100000:2.0:1789181518.749200:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9dc1b6c0a300 x1876092488079104/t0(0) o4->5971a429-48ca-4c07-88a3-fa58102a53bc@192.168.204.32@tcp:649/0 lens 504/0 e 0 to 0 dl 1789181529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789181518.749211:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9dc1b6c0a300 with x1876092488079104 ext(0->8) 00010000:00010000:2.0:1789181518.749231:0:6697:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000091461032/0x8f4f7840b2e41ef2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f32e expref: 9 pid: 6894 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.749303:0:6697:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000091461032/0x8f4f7840b2e41ef2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f32e expref: 9 pid: 6894 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789181518.749312:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9dc1b6c0a300 00000100:00100000:2.0:1789181518.749391:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 3 00000100:00100000:2.0:1789181518.749401:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6c0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+9:2353:x1876092488079104:12345-192.168.204.32@tcp:4:lfs.0 00000100:00100000:2.0:1789181518.750002:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6c0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+11:2353:x1876092488079104:12345-192.168.204.32@tcp:4:lfs.0 Request processed in 599us (1891us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1789181518.750010:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 3 00002000:00100000:2.0:1789181518.750018:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9dc1b6c0a300 x1876092488079104/t4294967308(0) o4->5971a429-48ca-4c07-88a3-fa58102a53bc@192.168.204.32@tcp:649/0 lens 504/448 e 0 to 0 dl 1789181529 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789181518.750033:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9dc1b6c0a300 with x1876092488079104 ext(0->8) 00010000:00010000:2.0:1789181518.750040:0:6697:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000091461032/0x8f4f7840b2e41ef2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f32e expref: 11 pid: 6894 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.750052:0:6697:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000091461032/0x8f4f7840b2e41ef2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f32e expref: 11 pid: 6894 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789181518.750059:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9dc1b6c0a300 00000100:00100000:3.0:1789181518.754115:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181518.754179:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488079232 00000100:00100000:2.0:1789181518.754188:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488079232 00010000:00010000:2.0:1789181518.754230:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000091461032/0x8f4f7840b2e41ef2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f32e expref: 11 pid: 6894 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181518.754300:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 76 00000100:00100000:2.0:1789181518.754310:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1825a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+11:2354:x1876092488079232:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789181518.754326:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789181518.754364:0:5828:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1789181518.754368:0:5828:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1789181519 00002000:00010000:2.0:1789181518.754370:0:5828:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1789181519 00002000:00010000:2.0:1789181518.754372:0:5828:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1789181519 00010000:00010000:2.0:1789181518.754378:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000091461032/0x8f4f7840b2e41ef2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f32e expref: 11 pid: 6894 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.754391:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000091461032/0x8f4f7840b2e41ef2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f32e expref: 11 pid: 6894 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.754416:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000091461032/0x8f4f7840b2e41ef2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f32e expref: 11 pid: 6894 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.754431:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=1s v=(1 0) 00010000:00010000:2.0:1789181518.754435:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789181518.754441:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008301596c/0x8f4f7840b2e41f31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.754451:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008301596c/0x8f4f7840b2e41f31 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.754475:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789181518.754577:0:6692:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008301596c/0x8f4f7840b2e41f31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181518.754588:0:6692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008301596c/0x8f4f7840b2e41f31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181518.754611:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008301596c/0x8f4f7840b2e41f31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181518.754620:0:6692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008301596c/0x8f4f7840b2e41f31 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181518.754639:0:6692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008301596c/0x8f4f7840b2e41f31 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181518.754646:0:6692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc189891a00 already unused, calling callback (ffffffffc152f9b0) 00010000:00010000:0.0:1789181518.754650:0:6692:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008301596c/0x8f4f7840b2e41f31 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181518.754659:0:6692:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008301596c/0x8f4f7840b2e41f31 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181518.754670:0:6692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008301596c/0x8f4f7840b2e41f31 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181518.754688:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008301596c/0x8f4f7840b2e41f31 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181518.755222:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1825a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+10:2354:x1876092488079232:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 910us (1124us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181518.755239:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 76 00000100:00100000:0.0:1789181518.756056:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6c0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+9:2353:x1876092488078976:12345-192.168.204.32@tcp:1:lfs.0 Request processed in 24077us (24305us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181518.756067:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 62 00000100:00100000:3.0:1789181518.760804:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181518.760890:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488079488 00000100:00100000:0.0:1789181518.760902:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488079488 00000100:00100000:0.0:1789181518.760959:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 56 00000100:00100000:0.0:1789181518.760969:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19928c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+43:11580:x1876092488079488:12345-192.168.204.32@tcp:35:lfs.0 00000004:00010000:0.0:1789181518.761032:0:5845:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258200/0x8f4f7840b2e41f23 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f343 expref: 43 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789181518.761314:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:0.0:1789181518.761392:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:0.0:1789181518.762452:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:0.0:1789181518.762540:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e41f38 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181518.762556:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891c00/0x8f4f7840b2e41edd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f320 expref: 47 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181518.762565:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e41f38 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181518.762604:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891c00/0x8f4f7840b2e41edd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f320 expref: 47 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181518.762619:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891c00/0x8f4f7840b2e41edd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f320 expref: 47 pid: 5844 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181518.762633:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b66f7100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5845:1876092510089984:192.168.204.32@tcp:104: 00000100:00100000:0.0:1789181518.762915:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1ba4b9cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789181518.765779:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181518.765892:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488079616 00000100:00100000:3.0:1789181518.765901:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488079616 00010000:00010000:3.0:1789181518.765940:0:6707:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891c00/0x8f4f7840b2e41edd lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f320 expref: 48 pid: 5844 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181518.765983:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 77 00000100:00100000:3.0:1789181518.765992:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6a28000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+48:2354:x1876092488079616:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789181518.766007:0:6707:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789181518.766014:0:6707:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891c00/0x8f4f7840b2e41edd lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f320 expref: 48 pid: 5844 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181518.766039:0:6707:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891c00/0x8f4f7840b2e41edd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f320 expref: 48 pid: 5844 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181518.766062:0:6707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9dc18553a500) 00010000:00010000:3.0:1789181518.766068:0:6707:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e41f38 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181518.766077:0:6707:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e41f38 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181518.766085:0:6707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e41f38 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181518.766117:0:6707:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789181518.766172:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6a28000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+48:2354:x1876092488079616:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 180us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181518.766180:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 77 00010000:00010000:2.0:1789181518.767704:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891c00/0x8f4f7840b2e41edd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f320 expref: 47 pid: 5844 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181518.767784:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b66f7100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5845:1876092510089984:192.168.204.32@tcp:104: 00010000:00010000:2.0:1789181518.767806:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e41f38 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.767815:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e41f38 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.767821:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e41f38 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789181518.767946:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:2.0:1789181518.768198:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:2.0:1789181518.768503:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfb2ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5845:1876092510090112:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789181518.768558:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181518.768596:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1879a6a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789181518.768662:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510090112 00000100:00100000:1.0:1789181518.768668:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510090112 00000100:00100000:1.0:1789181518.768749:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789181518.768759:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b66f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5845:x1876092510090112:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789181518.768830:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b66f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5845:x1876092510090112:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 74us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181518.768837:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789181518.768871:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfb2ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5845:1876092510090112:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1789181518.769368:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:1.0:1789181518.769423:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6c08e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5845:1876092510090240:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789181518.769453:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181518.769476:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510090240 00000100:00100000:1.0:1789181518.769480:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510090240 00000100:00100000:1.0:1789181518.769498:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789181518.769510:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6c0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5845:x1876092510090240:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789181518.769616:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6c0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:5845:x1876092510090240:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 107us (162us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1789181518.769622:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789181518.769637:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc08311d780 going to sleep for 11 seconds 00000100:00100000:1.0:1789181518.769652:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6c08e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5845:1876092510090240:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1789181518.769697:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:1.0:1789181518.769729:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e41f38 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181518.769739:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e41f38 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181518.769746:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e41f38 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181518.769751:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc189890000 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:1.0:1789181518.769755:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e41f38 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181518.769763:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e41f38 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181518.769777:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9dc18553a500) 00010000:00010000:1.0:1789181518.769780:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1789181518.769785:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e41f38 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181518.769792:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e41f38 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789181518.769945:0:5845:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789181518.770026:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:1.0:1789181518.770036:0:5845:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 411026704053ns, next at 412026702365ns, rc = 0 00000001:00080000:1.0:1789181518.770041:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:1.0:1789181518.770070:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9dc18553a500) 00010000:00010000:1.0:1789181518.770073:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789181518.770079:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258200/0x8f4f7840b2e41f23 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f343 expref: 51 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181518.770163:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19928c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+50:11580:x1876092488079488:12345-192.168.204.32@tcp:35:lfs.0 Request processed in 9196us (10471us total) trans 4294967494 rc 0/0 00000100:00100000:1.0:1789181518.770170:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 56 00000020:00080000:1.0:1789181518.770174:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:0.0:1789181518.771228:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789181518.772806:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181518.773069:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488079744 00000100:00100000:3.0:1789181518.773078:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488079744 00000100:00100000:3.0:1789181518.773164:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 202 00000100:00100000:3.0:1789181518.773173:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6a2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+50:11580:x1876092488079744:12345-192.168.204.32@tcp:101:lfs.0 00010000:00010000:3.0:1789181518.773195:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181518.773216:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e41f3f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f34a expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181518.773287:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e41f3f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f34a expref: 51 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181518.773323:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e41f3f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f34a expref: 51 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181518.773365:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9dc192187700) 00010000:00010000:3.0:1789181518.773368:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789181518.773372:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1bfa1f400, rc 0) 00000100:00100000:3.0:1789181518.773434:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6a2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+51:11580:x1876092488079744:12345-192.168.204.32@tcp:101:lfs.0 Request processed in 262us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181518.773441:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 202 00000100:00100000:1.0:1789181518.776092:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181518.776162:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488080000 00000100:00100000:2.0:1789181518.776171:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488080000 00000100:00100000:2.0:1789181518.776223:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 57 00000100:00100000:2.0:1789181518.776240:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6c09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+51:11580:x1876092488080000:12345-192.168.204.32@tcp:35:lfs.0 00000100:00100000:2.0:1789181518.776473:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6c09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+52:11580:x1876092488080000:12345-192.168.204.32@tcp:35:lfs.0 Request processed in 241us (388us total) trans 4294967495 rc 0/0 00000100:00100000:2.0:1789181518.776480:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 57 00000100:00100000:3.0:1789181518.846629:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789181518.846654:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b66f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876092510090368:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789181518.846744:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181518.846900:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510090368 00000100:00100000:0.0:1789181518.846908:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510090368 00000100:00100000:0.0:1789181518.846964:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789181518.846973:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1825a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3304:x1876092510090368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789181518.847021:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 54460416 pending 3407872 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789181518.847073:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1825a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3304:x1876092510090368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181518.847080:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789181518.847405:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b66f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876092510090368:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789181518.871317:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181518.871459:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488080128 00000100:00100000:3.0:1789181518.871469:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488080128 00000100:00100000:3.0:1789181518.871526:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 203 00000100:00100000:3.0:1789181518.871536:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6a2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+52:11590:x1876092488080128:12345-192.168.204.32@tcp:34:lfs.0 00010000:00010000:3.0:1789181518.871605:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e41f46 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181518.871621:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e41f46 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181518.871632:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e41f46 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181518.871646:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e41f4d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181518.871686:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e41f4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181518.871694:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e41f4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181518.871792:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e41f54 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181518.871799:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e41f54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181518.871806:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e41f54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789181518.871846:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e41f54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181518.871858:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e41f46 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181518.871864:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e41f46 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181518.871871:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e41f46 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181518.871876:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1bfa1fc00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:3.0:1789181518.871880:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e41f46 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181518.871888:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e41f46 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181518.871906:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9dc1995b7800) 00010000:00010000:3.0:1789181518.871909:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181518.871914:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e41f46 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181518.871920:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e41f46 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181518.871936:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e41f4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181518.871942:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e41f4d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181518.871948:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e41f4d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181518.871953:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1bfa1fe00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:3.0:1789181518.871956:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e41f4d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181518.871962:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e41f4d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181518.871969:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9dc192187f00) 00010000:00010000:3.0:1789181518.871971:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181518.871974:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e41f4d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181518.871980:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e41f4d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181518.872002:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e41f54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181518.872008:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e41f54 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181518.872014:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e41f54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181518.872018:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1bfa1fa00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:3.0:1789181518.872021:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e41f54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181518.872027:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e41f54 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181518.872033:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9dc192187700) 00010000:00010000:3.0:1789181518.872035:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181518.872038:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e41f54 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181518.872044:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e41f54 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181518.872513:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6a2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+52:11590:x1876092488080128:12345-192.168.204.32@tcp:34:lfs.0 Request processed in 976us (1201us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181518.872523:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 203 00000100:00100000:0.0:1789181518.909355:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181518.909451:0:6887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488080384 00000100:00100000:2.0:1789181518.909461:0:6887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488080384 00000100:00100000:2.0:1789181518.909519:0:6887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 204 00000100:00100000:2.0:1789181518.909529:0:6887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6a2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+52:11593:x1876092488080384:12345-192.168.204.32@tcp:101:lfs.0 00010000:00010000:2.0:1789181518.909550:0:6887:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181518.909570:0:6887:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259e00/0x8f4f7840b2e41f5b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f351 expref: -99 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.909642:0:6887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258000/0x8f4f7840b2e41f62 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.909656:0:6887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258000/0x8f4f7840b2e41f62 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.909668:0:6887:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258000/0x8f4f7840b2e41f62 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.909695:0:6887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258a00/0x8f4f7840b2e41f69 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.909703:0:6887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258a00/0x8f4f7840b2e41f69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.909717:0:6887:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258a00/0x8f4f7840b2e41f69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.909829:0:6887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259c00/0x8f4f7840b2e41f70 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.909837:0:6887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259c00/0x8f4f7840b2e41f70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.909859:0:6887:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259c00/0x8f4f7840b2e41f70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789181518.909869:0:6887:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1789181518.909966:0:6887:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258000/0x8f4f7840b2e41f62 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.909974:0:6887:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258000/0x8f4f7840b2e41f62 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.909981:0:6887:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258000/0x8f4f7840b2e41f62 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.909986:0:6887:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1c0258000 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:2.0:1789181518.909991:0:6887:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258000/0x8f4f7840b2e41f62 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.909998:0:6887:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258000/0x8f4f7840b2e41f62 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.910186:0:6887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9dc1995b7800) 00010000:00010000:2.0:1789181518.910191:0:6887:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789181518.910196:0:6887:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258000/0x8f4f7840b2e41f62 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.910202:0:6887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258000/0x8f4f7840b2e41f62 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.910216:0:6887:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258a00/0x8f4f7840b2e41f69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.910221:0:6887:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258a00/0x8f4f7840b2e41f69 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.910233:0:6887:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258a00/0x8f4f7840b2e41f69 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.910238:0:6887:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1c0258a00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:2.0:1789181518.910241:0:6887:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258a00/0x8f4f7840b2e41f69 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.910247:0:6887:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258a00/0x8f4f7840b2e41f69 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.910254:0:6887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9dc1995b7300) 00010000:00010000:2.0:1789181518.910256:0:6887:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789181518.910259:0:6887:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258a00/0x8f4f7840b2e41f69 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.910264:0:6887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258a00/0x8f4f7840b2e41f69 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.910304:0:6887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259e00/0x8f4f7840b2e41f5b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f351 expref: 55 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.910317:0:6887:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259c00/0x8f4f7840b2e41f70 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f351 expref: 54 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.910323:0:6887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9dc192187700) 00010000:00010000:2.0:1789181518.910325:0:6887:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789181518.910327:0:6887:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1c0259c00, rc 0) 00000100:00100000:2.0:1789181518.910438:0:6887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6a2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+54:11593:x1876092488080384:12345-192.168.204.32@tcp:101:lfs.0 Request processed in 910us (1116us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1789181518.910457:0:6887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 204 00000100:00100000:1.0:1789181518.914526:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181518.914596:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488080512 00000100:00100000:2.0:1789181518.914605:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488080512 00000100:00100000:2.0:1789181518.914658:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 205 00000100:00100000:2.0:1789181518.914668:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6c08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+54:11593:x1876092488080512:12345-192.168.204.32@tcp:54:lfs.0 00010000:00010000:2.0:1789181518.914756:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259800/0x8f4f7840b2e41f7e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.914772:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259800/0x8f4f7840b2e41f7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.914783:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259800/0x8f4f7840b2e41f7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.914805:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259800/0x8f4f7840b2e41f7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.914811:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259800/0x8f4f7840b2e41f7e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.914817:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259800/0x8f4f7840b2e41f7e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.914823:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1c0259800 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:2.0:1789181518.914827:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259800/0x8f4f7840b2e41f7e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.914834:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259800/0x8f4f7840b2e41f7e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.914844:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9dc192187700) 00010000:00010000:2.0:1789181518.914858:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789181518.914863:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259800/0x8f4f7840b2e41f7e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.914868:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259800/0x8f4f7840b2e41f7e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181518.914937:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6c08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+54:11593:x1876092488080512:12345-192.168.204.32@tcp:54:lfs.0 Request processed in 270us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181518.914944:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 205 00000100:00100000:1.0:1789181518.917802:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181518.917870:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488080768 00000100:00100000:2.0:1789181518.917879:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488080768 00000100:00100000:2.0:1789181518.917929:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 58 00000100:00100000:2.0:1789181518.917939:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6c0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+54:11593:x1876092488080768:12345-192.168.204.32@tcp:35:lfs.0 00000100:00100000:2.0:1789181518.918169:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6c0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+55:11593:x1876092488080768:12345-192.168.204.32@tcp:35:lfs.0 Request processed in 230us (376us total) trans 4294967497 rc 0/0 00000100:00100000:2.0:1789181518.918176:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 58 00000100:00100000:0.0:1789181518.993603:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181518.993706:0:6887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488081024 00000100:00100000:2.0:1789181518.993723:0:6887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488081024 00000100:00100000:2.0:1789181518.993790:0:6887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 206 00000100:00100000:2.0:1789181518.993802:0:6887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6a28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+55:11603:x1876092488081024:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:2.0:1789181518.993826:0:6887:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181518.993829:0:6887:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789181518.993856:0:6887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e800/0x8f4f7840b2e41f00 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f335 expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.993875:0:6887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9dc1995b7800) 00010000:00010000:2.0:1789181518.993880:0:6887:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789181518.993907:0:6887:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259800/0x8f4f7840b2e41f85 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f358 expref: -99 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.994004:0:6887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259e00/0x8f4f7840b2e41f8c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.994018:0:6887:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259c00/0x8f4f7840b2e41f70 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f351 expref: 55 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.994027:0:6887:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259e00/0x8f4f7840b2e41f8c lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.994058:0:6887:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259c00/0x8f4f7840b2e41f70 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f351 expref: 55 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.994071:0:6887:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259c00/0x8f4f7840b2e41f70 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f351 expref: 55 pid: 6887 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181518.994083:0:6887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b66f7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6887:1876092510090496:192.168.204.32@tcp:104: 00000100:00100000:2.0:1789181518.994187:0:6887:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1879a6540 going to sleep for 11 seconds 00000100:00100000:2.0:1789181518.996370:0:6887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b66f7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6887:1876092510090496:192.168.204.32@tcp:104: 00010000:00010000:2.0:1789181518.996398:0:6887:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259e00/0x8f4f7840b2e41f8c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181518.997235:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181518.997503:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488081152 00000100:00100000:2.0:1789181518.997509:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488081152 00010000:00010000:2.0:1789181518.997540:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259c00/0x8f4f7840b2e41f70 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f351 expref: 56 pid: 6887 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181518.997615:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 78 00000100:00100000:2.0:1789181518.997623:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6a2b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+56:2354:x1876092488081152:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789181518.997636:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789181518.997641:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259c00/0x8f4f7840b2e41f70 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f351 expref: 56 pid: 6887 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.997649:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259c00/0x8f4f7840b2e41f70 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f351 expref: 56 pid: 6887 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.997666:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259c00/0x8f4f7840b2e41f70 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f351 expref: 56 pid: 6887 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.997693:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9dc192187700) 00010000:00010000:2.0:1789181518.997698:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259e00/0x8f4f7840b2e41f8c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.997770:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259e00/0x8f4f7840b2e41f8c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.997778:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259e00/0x8f4f7840b2e41f8c lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181518.997809:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789181518.997930:0:6887:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259e00/0x8f4f7840b2e41f8c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181518.997939:0:6887:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259e00/0x8f4f7840b2e41f8c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789181518.997964:0:6887:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1789181518.998124:0:6887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259800/0x8f4f7840b2e41f85 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f358 expref: 57 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181518.998139:0:6887:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259e00/0x8f4f7840b2e41f8c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f358 expref: 56 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181518.998146:0:6887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9dc192187700) 00010000:00010000:3.0:1789181518.998149:0:6887:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789181518.998152:0:6887:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1c0259e00, rc 0) 00000100:00100000:2.0:1789181518.998194:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6a2b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+56:2354:x1876092488081152:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 570us (962us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181518.998201:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 78 00000100:00100000:3.0:1789181518.998448:0:6887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6a28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+55:11603:x1876092488081024:12345-192.168.204.32@tcp:101:bash.0 Request processed in 4647us (4854us total) trans 4294967498 rc 0/0 00000100:00100000:3.0:1789181518.998456:0:6887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 206 00000100:00100000:3.0:1789181519.001096:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181519.001578:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488081408 00000100:00100000:2.0:1789181519.001601:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488081408 00000100:00100000:2.0:1789181519.001698:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 207 00000100:00100000:2.0:1789181519.001709:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1825a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+55:11603:x1876092488081408:12345-192.168.204.32@tcp:36:bash.0 00010000:00010000:2.0:1789181519.002151:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258a00/0x8f4f7840b2e41f9a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.002169:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258a00/0x8f4f7840b2e41f9a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.002179:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258a00/0x8f4f7840b2e41f9a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789181519.002234:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:2.0:1789181519.002258:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000098bb615a reply state 00000000f606c9a8 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258a00/0x8f4f7840b2e41f9a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181519.002266:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789181519.002717:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1825a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+58:11603:x1876092488081408:12345-192.168.204.32@tcp:36:bash.0 Request processed in 1001us (1620us total) trans 4294967500 rc 0/0 00000100:00100000:2.0:1789181519.002725:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 207 00000020:00080000:2.0:1789181519.002731:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789181519.006327:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181519.006586:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488081536 00000100:00100000:0.0:1789181519.006598:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488081536 00000100:00100000:0.0:1789181519.006691:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 208 00000100:00100000:0.0:1789181519.006701:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6c09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+58:11603:x1876092488081536:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:0.0:1789181519.006731:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181519.006749:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891600/0x8f4f7840b2e41fa1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f35f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181519.006841:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e41fa8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181519.006854:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259e00/0x8f4f7840b2e41f8c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f358 expref: 59 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181519.006863:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258a00/0x8f4f7840b2e41f9a lrc: 2/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181519.006870:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e41fa8 lrc: 5/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181519.006887:0:5844:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258a00/0x8f4f7840b2e41f9a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181519.006927:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259e00/0x8f4f7840b2e41f8c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f358 expref: 59 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181519.006940:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259e00/0x8f4f7840b2e41f8c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f358 expref: 59 pid: 6887 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181519.006953:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6a28a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1876092510090624:192.168.204.32@tcp:104: 00000100:00100000:0.0:1789181519.007024:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1ba4b9840 going to sleep for 11 seconds 00010000:00010000:3.0:1789181519.008627:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258a00/0x8f4f7840b2e41f9a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181519.008641:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258a00/0x8f4f7840b2e41f9a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181519.008648:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258a00/0x8f4f7840b2e41f9a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181519.008654:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1c0258a00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:3.0:1789181519.008658:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258a00/0x8f4f7840b2e41f9a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181519.008666:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258a00/0x8f4f7840b2e41f9a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181519.008708:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9dc192187700) 00010000:00010000:3.0:1789181519.008711:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181519.008715:0:3290:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e41fa8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181519.008726:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258a00/0x8f4f7840b2e41f9a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181519.008732:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258a00/0x8f4f7840b2e41f9a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181519.009646:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181519.009720:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488081664 00000100:00100000:3.0:1789181519.009726:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6a28a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1876092510090624:192.168.204.32@tcp:104: 00000100:00100000:2.0:1789181519.009727:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488081664 00010000:00010000:3.0:1789181519.009748:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e41fa8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.009756:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259e00/0x8f4f7840b2e41f8c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f358 expref: 59 pid: 6887 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181519.009783:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 79 00000100:00100000:2.0:1789181519.009791:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6a2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+59:2353:x1876092488081664:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789181519.009806:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789181519.009812:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259e00/0x8f4f7840b2e41f8c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f358 expref: 59 pid: 6887 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.009835:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259e00/0x8f4f7840b2e41f8c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f358 expref: 59 pid: 6887 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.009853:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259e00/0x8f4f7840b2e41f8c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f358 expref: 59 pid: 6887 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.009866:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9dc192187700) 00010000:00010000:2.0:1789181519.009959:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e41fa8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.009969:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e41fa8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.009976:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e41fa8 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.010004:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789181519.010100:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6a2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+58:2353:x1876092488081664:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 308us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181519.010116:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 79 00010000:00010000:3.0:1789181519.010217:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e41fa8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181519.010224:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e41fa8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789181519.010272:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1789181519.010277:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789181519.010294:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e41fa8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181519.010320:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891600/0x8f4f7840b2e41fa1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f35f expref: 58 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181519.010357:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e41fa8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f35f expref: 57 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181519.010371:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9dc192187700) 00010000:00010000:3.0:1789181519.010374:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789181519.010377:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc189890000, rc 0) 00000100:00100000:3.0:1789181519.010401:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6c09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+57:11603:x1876092488081536:12345-192.168.204.32@tcp:101:bash.0 Request processed in 3702us (4085us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181519.010408:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 208 00000100:00100000:0.0:1789181519.014741:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181519.015020:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488081920 00000100:00100000:2.0:1789181519.015031:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488081920 00000100:00100000:2.0:1789181519.015132:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 59 00000100:00100000:2.0:1789181519.015142:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6a29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+57:11603:x1876092488081920:12345-192.168.204.32@tcp:35:bash.0 00000100:00100000:2.0:1789181519.015496:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6a29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+58:11603:x1876092488081920:12345-192.168.204.32@tcp:35:bash.0 Request processed in 355us (768us total) trans 4294967501 rc 0/0 00000100:00100000:2.0:1789181519.015504:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 59 00000100:00100000:1.0:1789181519.105375:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181519.105453:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488082048 00000100:00100000:3.0:1789181519.105464:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488082048 00000100:00100000:3.0:1789181519.105519:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 209 00000100:00100000:3.0:1789181519.105528:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6c0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+58:11609:x1876092488082048:12345-192.168.204.32@tcp:101:lfs.0 00010000:00010000:3.0:1789181519.105552:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181519.105570:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e41faf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f366 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181519.105646:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e41fb6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181519.105664:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e41fb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181519.105686:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e41fb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789181519.105729:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1789181519.105732:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789181519.105749:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e41fb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181519.105807:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e41faf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f366 expref: 60 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181519.105826:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e41fb6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f366 expref: 59 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181519.105834:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9dc1995b7800) 00010000:00010000:3.0:1789181519.105837:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789181519.105841:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1bfa1fe00, rc 0) 00000100:00100000:3.0:1789181519.105904:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6c0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+59:11609:x1876092488082048:12345-192.168.204.32@tcp:101:lfs.0 Request processed in 376us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181519.105911:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 209 00000100:00100000:0.0:1789181519.110582:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181519.110692:0:6887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488082176 00000100:00100000:2.0:1789181519.110701:0:6887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488082176 00000100:00100000:2.0:1789181519.110766:0:6887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 210 00000100:00100000:2.0:1789181519.110777:0:6887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6a2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+59:11609:x1876092488082176:12345-192.168.204.32@tcp:101:lfs.0 00010000:00010000:2.0:1789181519.110807:0:6887:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181519.110826:0:6887:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259e00/0x8f4f7840b2e41fbd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f36d expref: -99 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.110910:0:6887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259c00/0x8f4f7840b2e41fc4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.110924:0:6887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259c00/0x8f4f7840b2e41fc4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.110936:0:6887:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259c00/0x8f4f7840b2e41fc4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.110952:0:6887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258000/0x8f4f7840b2e41fcb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.110959:0:6887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258000/0x8f4f7840b2e41fcb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.110966:0:6887:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258000/0x8f4f7840b2e41fcb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.111049:0:6887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258600/0x8f4f7840b2e41fd2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.111058:0:6887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258600/0x8f4f7840b2e41fd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.111078:0:6887:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258600/0x8f4f7840b2e41fd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789181519.111266:0:6887:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1789181519.111271:0:6887:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789181519.111291:0:6887:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258600/0x8f4f7840b2e41fd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.111304:0:6887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258600/0x8f4f7840b2e41fd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.111313:0:6887:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259c00/0x8f4f7840b2e41fc4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.111320:0:6887:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259c00/0x8f4f7840b2e41fc4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.111328:0:6887:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259c00/0x8f4f7840b2e41fc4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.111377:0:6887:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1c0259c00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:2.0:1789181519.111381:0:6887:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259c00/0x8f4f7840b2e41fc4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.111390:0:6887:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259c00/0x8f4f7840b2e41fc4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.111403:0:6887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9dc1995b7800) 00010000:00010000:2.0:1789181519.111406:0:6887:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789181519.111411:0:6887:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259c00/0x8f4f7840b2e41fc4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.111428:0:6887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259c00/0x8f4f7840b2e41fc4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.111443:0:6887:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258000/0x8f4f7840b2e41fcb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.111450:0:6887:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258000/0x8f4f7840b2e41fcb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.111457:0:6887:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258000/0x8f4f7840b2e41fcb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.111462:0:6887:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1c0258000 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:2.0:1789181519.111466:0:6887:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258000/0x8f4f7840b2e41fcb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.111472:0:6887:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258000/0x8f4f7840b2e41fcb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.111481:0:6887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9dc1995b7300) 00010000:00010000:2.0:1789181519.111484:0:6887:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789181519.111487:0:6887:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258000/0x8f4f7840b2e41fcb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.111493:0:6887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258000/0x8f4f7840b2e41fcb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.111526:0:6887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259e00/0x8f4f7840b2e41fbd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f36d expref: 61 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.111540:0:6887:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258600/0x8f4f7840b2e41fd2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f36d expref: 60 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.111554:0:6887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9dc192187700) 00010000:00010000:2.0:1789181519.111557:0:6887:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789181519.111560:0:6887:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1c0258600, rc 0) 00000100:00100000:2.0:1789181519.111618:0:6887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6a2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+60:11609:x1876092488082176:12345-192.168.204.32@tcp:101:lfs.0 Request processed in 842us (1045us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181519.111625:0:6887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 210 00000100:00100000:0.0:1789181519.116740:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181519.116904:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488082432 00000100:00100000:3.0:1789181519.116915:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488082432 00000100:00100000:3.0:1789181519.116972:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 211 00000100:00100000:3.0:1789181519.116984:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6a28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+60:11609:x1876092488082432:12345-192.168.204.32@tcp:101:lfs.0 00010000:00010000:3.0:1789181519.117005:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181519.117025:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e41fd9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f374 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181519.117125:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ec00/0x8f4f7840b2e41fe0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181519.117142:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e41fa8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f35f expref: 61 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181519.117149:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258600/0x8f4f7840b2e41fd2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f36d expref: 61 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181519.117169:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ec00/0x8f4f7840b2e41fe0 lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181519.117205:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258600/0x8f4f7840b2e41fd2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f36d expref: 61 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181519.117217:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258600/0x8f4f7840b2e41fd2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f36d expref: 61 pid: 6887 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181519.117242:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1825a3480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1876092510090752:192.168.204.32@tcp:104: 00010000:00010000:3.0:1789181519.117363:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e41fa8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f35f expref: 61 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181519.117373:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e41fa8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f35f expref: 61 pid: 5844 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181519.117382:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c0268000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1876092510090880:192.168.204.32@tcp:104: 00000100:00100000:3.0:1789181519.117408:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1884b5540 going to sleep for 11 seconds 00000100:00100000:0.0:1789181519.123117:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00010000:00010000:3.0:1789181519.123654:0:5843:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.32@tcp) returned -22 from blocking AST (req@00000000597765e4 x1876092510090752) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258600/0x8f4f7840b2e41fd2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f36d expref: 61 pid: 6887 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181519.123688:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258600/0x8f4f7840b2e41fd2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f36d expref: 61 pid: 6887 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181519.123722:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258600/0x8f4f7840b2e41fd2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f36d expref: 61 pid: 6887 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181519.123756:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1825a3480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1876092510090752:192.168.204.32@tcp:104: 00000100:00100000:1.0:1789181519.124083:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488082560 00000100:00100000:1.0:1789181519.124091:0:8456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488082560 00000100:00100000:1.0:1789181519.124167:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 16 00000100:00100000:1.0:1789181519.124178:0:8456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6a29f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5971a429-48ca-4c07-88a3-fa58102a53bc+61:2352:x1876092488082560:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789181519.124194:0:8456:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789181519.124197:0:8456:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 8f4f7840b2e41fd2) 00010000:00010000:1.0:1789181519.124199:0:8456:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789181519.124265:0:8456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6a29f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5971a429-48ca-4c07-88a3-fa58102a53bc+61:2352:x1876092488082560:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 87us (1168us total) trans 0 rc 116/116 00000100:00100000:1.0:1789181519.124282:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 16 00000100:00100000:3.0:1789181519.126747:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c0268000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1876092510090880:192.168.204.32@tcp:104: 00010000:00010000:3.0:1789181519.126779:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9dc192187700) 00010000:00010000:3.0:1789181519.126787:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ec00/0x8f4f7840b2e41fe0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181519.126807:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ec00/0x8f4f7840b2e41fe0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181519.126816:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ec00/0x8f4f7840b2e41fe0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181519.128165:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181519.128380:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488082688 00000100:00100000:2.0:1789181519.128390:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488082688 00010000:00010000:2.0:1789181519.128426:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e41fa8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f35f expref: 61 pid: 5844 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181519.128460:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 80 00000100:00100000:2.0:1789181519.128470:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19619e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+61:2353:x1876092488082688:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789181519.128484:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789181519.128491:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e41fa8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f35f expref: 61 pid: 5844 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.128504:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e41fa8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f35f expref: 61 pid: 5844 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.128525:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e41fa8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f35f expref: 61 pid: 5844 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.128540:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9dc192187700) 00010000:00010000:2.0:1789181519.128544:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ec00/0x8f4f7840b2e41fe0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.128565:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ec00/0x8f4f7840b2e41fe0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.128574:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ec00/0x8f4f7840b2e41fe0 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.128600:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789181519.128645:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19619e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+60:2353:x1876092488082688:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 177us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181519.128652:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 80 00010000:00010000:1.0:1789181519.129002:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ec00/0x8f4f7840b2e41fe0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181519.129010:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ec00/0x8f4f7840b2e41fe0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789181519.129028:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1789181519.129168:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e41fd9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f374 expref: 61 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181519.129183:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ec00/0x8f4f7840b2e41fe0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f374 expref: 60 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181519.129191:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9dc192187700) 00010000:00010000:1.0:1789181519.129193:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789181519.129195:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1bfa1ec00, rc 0) 00000100:00100000:1.0:1789181519.129237:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6a28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+60:11609:x1876092488082432:12345-192.168.204.32@tcp:101:lfs.0 Request processed in 12256us (12506us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1789181519.129245:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 211 00000100:00100000:0.0:1789181519.133534:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181519.133629:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488082944 00000100:00100000:2.0:1789181519.133639:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488082944 00000100:00100000:2.0:1789181519.133705:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 17 00000100:00100000:2.0:1789181519.133724:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6a29880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+60:11609:x1876092488082944:12345-192.168.204.32@tcp:103:lfs.0 00010000:00010000:2.0:1789181519.133739:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789181519.133763:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e41f3f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f34a expref: 60 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.133781:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9dc192187700) 00010000:00010000:2.0:1789181519.133786:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789181519.133842:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6a29880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+59:11609:x1876092488082944:12345-192.168.204.32@tcp:103:lfs.0 Request processed in 121us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181519.133850:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 17 00000100:00100000:0.0:1789181519.137316:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181519.137457:0:6887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488083072 00000100:00100000:2.0:1789181519.137467:0:6887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488083072 00000100:00100000:2.0:1789181519.137523:0:6887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 212 00000100:00100000:2.0:1789181519.137534:0:6887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6a29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+59:11609:x1876092488083072:12345-192.168.204.32@tcp:58:lfs.0 00010000:00010000:2.0:1789181519.137658:0:6887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259e00/0x8f4f7840b2e41fee lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.137687:0:6887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259e00/0x8f4f7840b2e41fee lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.137698:0:6887:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259e00/0x8f4f7840b2e41fee lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789181519.137907:0:6887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1789181519.137987:0:6887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6a29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+59:11609:x1876092488083072:12345-192.168.204.32@tcp:58:lfs.0 Request processed in 455us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181519.137995:0:6887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 212 00000100:00100000:0.0:1789181519.141082:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181519.141402:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488083200 00000100:00100000:2.0:1789181519.141411:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488083200 00000100:00100000:2.0:1789181519.141471:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 213 00000100:00100000:2.0:1789181519.141481:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6a28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+59:11609:x1876092488083200:12345-192.168.204.32@tcp:101:lfs.0 00010000:00010000:2.0:1789181519.141500:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181519.141519:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258000/0x8f4f7840b2e41ff5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f37b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.141574:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259e00/0x8f4f7840b2e41fee lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.141584:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258000/0x8f4f7840b2e41ff5 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f37b expref: 60 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.141601:0:5842:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259e00/0x8f4f7840b2e41fee lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.141632:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258000/0x8f4f7840b2e41ff5 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f37b expref: 60 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.141646:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9dc192187700) 00010000:00010000:2.0:1789181519.141649:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789181519.141652:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258000/0x8f4f7840b2e41ff5 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f37b expref: 60 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.141660:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1c0258000, rc 0) 00000100:00100000:2.0:1789181519.141730:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6a28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+60:11609:x1876092488083200:12345-192.168.204.32@tcp:101:lfs.0 Request processed in 251us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181519.141737:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 213 00010000:00010000:3.0:1789181519.422857:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789181519.456066:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:1.0:1789181519.456085:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:1.0:1789181519.456096:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000040:00080000:2.0:1789181519.550593:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789181519.550606:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789181519.551229:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:2.0:1789181519.551240:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789181519.551420:0:11694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b66f7b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11694:1876092510091008:192.168.204.32@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789181519.551539:0:11694:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc0821f43c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789181519.567601:0:11694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b66f7b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11694:1876092510091008:192.168.204.32@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789181519.570326:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181519.570926:0:6887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488083328 00000100:00100000:2.0:1789181519.570936:0:6887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488083328 00000100:00100000:2.0:1789181519.571061:0:6887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 214 00000100:00100000:2.0:1789181519.571073:0:6887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6a29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+60:11610:x1876092488083328:12345-192.168.204.32@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789181519.571104:0:6887:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789181519.571208:0:6887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6a29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+60:11610:x1876092488083328:12345-192.168.204.32@tcp:53:lhsmtool_posix.0 Request processed in 137us (893us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181519.571230:0:6887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 214 00000100:00100000:0.0:1789181519.589880:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181519.589964:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488083456 00000100:00100000:2.0:1789181519.589976:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488083456 00000100:00100000:2.0:1789181519.590053:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 215 00000100:00100000:2.0:1789181519.590064:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6a2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+60:11610:x1876092488083456:12345-192.168.204.32@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789181519.590143:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259c00/0x8f4f7840b2e41ffc lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.590161:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259c00/0x8f4f7840b2e41ffc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.590186:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259c00/0x8f4f7840b2e41ffc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.590204:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259200/0x8f4f7840b2e42003 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.590212:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259200/0x8f4f7840b2e42003 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.590219:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259200/0x8f4f7840b2e42003 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.590243:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258c00/0x8f4f7840b2e4200a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.590251:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258c00/0x8f4f7840b2e4200a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.590257:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258c00/0x8f4f7840b2e4200a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789181519.590310:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1789181519.590314:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789181519.590327:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258c00/0x8f4f7840b2e4200a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.590379:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259c00/0x8f4f7840b2e41ffc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.590385:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259c00/0x8f4f7840b2e41ffc lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.590393:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259c00/0x8f4f7840b2e41ffc lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.590398:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1c0259c00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:2.0:1789181519.590403:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259c00/0x8f4f7840b2e41ffc lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.590410:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259c00/0x8f4f7840b2e41ffc lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.590422:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9dc192187200) 00010000:00010000:2.0:1789181519.590425:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789181519.590430:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259c00/0x8f4f7840b2e41ffc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.590447:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259c00/0x8f4f7840b2e41ffc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.590460:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259200/0x8f4f7840b2e42003 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.590477:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259200/0x8f4f7840b2e42003 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.590482:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259200/0x8f4f7840b2e42003 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.590487:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1c0259200 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:2.0:1789181519.590490:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259200/0x8f4f7840b2e42003 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.590496:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259200/0x8f4f7840b2e42003 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.590504:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff9dc1995b7b00) 00010000:00010000:2.0:1789181519.590507:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789181519.590510:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259200/0x8f4f7840b2e42003 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.590515:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259200/0x8f4f7840b2e42003 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.590531:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258c00/0x8f4f7840b2e4200a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.590537:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258c00/0x8f4f7840b2e4200a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.590542:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258c00/0x8f4f7840b2e4200a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.590547:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1c0258c00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:2.0:1789181519.590555:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258c00/0x8f4f7840b2e4200a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.590562:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258c00/0x8f4f7840b2e4200a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.590569:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9dc192187700) 00010000:00010000:2.0:1789181519.590571:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789181519.590574:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258c00/0x8f4f7840b2e4200a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.590580:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258c00/0x8f4f7840b2e4200a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181519.590651:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6a2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+60:11610:x1876092488083456:12345-192.168.204.32@tcp:34:lhsmtool_posix.0 Request processed in 588us (782us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181519.590670:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 215 00000100:00100000:0.0:1789181519.593439:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181519.593678:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488083712 00000100:00100000:3.0:1789181519.593689:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488083712 00000100:00100000:3.0:1789181519.593760:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 216 00000100:00100000:3.0:1789181519.593777:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6a2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+60:11610:x1876092488083712:12345-192.168.204.32@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789181519.593797:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181519.593817:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e42011 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f382 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181519.594105:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e42018 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181519.594133:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e42018 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181519.594190:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e42018 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789181519.594201:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1789181519.594324:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e42018 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181519.594375:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e42018 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181519.594383:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e42018 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181519.594389:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1bfa1ee00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:3.0:1789181519.594393:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e42018 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181519.594401:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e42018 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181519.594414:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9dc192187700) 00010000:00010000:3.0:1789181519.594416:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789181519.594421:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e42018 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181519.594427:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e42018 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181519.594469:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e42011 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f382 expref: 62 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181519.594492:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9dc192187200) 00010000:00010000:3.0:1789181519.594494:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789181519.594499:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e42011 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f382 expref: 62 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181519.594509:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1bfa1fa00, rc 0) 00000100:00100000:3.0:1789181519.594583:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6a2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+61:11610:x1876092488083712:12345-192.168.204.32@tcp:101:lhsmtool_posix.0 Request processed in 814us (1158us total) trans 4294967503 rc 301/301 00000100:00100000:3.0:1789181519.594591:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 216 00000100:00100000:1.0:1789181519.619923:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181519.620181:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488083840 00000100:00100000:3.0:1789181519.620191:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488083840 00000100:00100000:3.0:1789181519.620254:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 217 00000100:00100000:3.0:1789181519.620266:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6c08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+61:11610:x1876092488083840:12345-192.168.204.32@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789181519.620301:0:5843:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789181519.620421:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6c08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+61:11610:x1876092488083840:12345-192.168.204.32@tcp:53:lhsmtool_posix.0 Request processed in 157us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181519.620428:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 217 00000100:00100000:0.0:1789181519.625095:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181519.625243:0:6887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488084096 00000100:00100000:2.0:1789181519.625252:0:6887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488084096 00000100:00100000:2.0:1789181519.625315:0:6887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 218 00000100:00100000:2.0:1789181519.625326:0:6887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6a28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+61:11610:x1876092488084096:12345-192.168.204.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789181519.625377:0:6887:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181519.625380:0:6887:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789181519.625411:0:6887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e41fb6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f366 expref: 61 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.625432:0:6887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9dc1995b7800) 00010000:00010000:2.0:1789181519.625437:0:6887:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789181519.625452:0:6887:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258c00/0x8f4f7840b2e42026 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f389 expref: -99 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789181519.626406:0:6887:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:2.0:1789181519.626624:0:6887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259200/0x8f4f7840b2e4202d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.626640:0:6887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259200/0x8f4f7840b2e4202d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.626652:0:6887:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259200/0x8f4f7840b2e4202d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.627420:0:6887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258c00/0x8f4f7840b2e42026 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f389 expref: 63 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.627441:0:6887:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259200/0x8f4f7840b2e4202d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f389 expref: 62 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.627450:0:6887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9dc1995b7b00) 00010000:00010000:2.0:1789181519.627453:0:6887:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789181519.627456:0:6887:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1c0259200, rc 0) 00000100:00100000:2.0:1789181519.627532:0:6887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6a28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+62:11610:x1876092488084096:12345-192.168.204.32@tcp:101:lhsmtool_posix.0 Request processed in 2207us (2446us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1789181519.627542:0:6887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 218 00000100:00100000:0.0:1789181519.630473:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181519.630609:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488084352 00000100:00100000:3.0:1789181519.630619:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488084352 00000100:00100000:3.0:1789181519.630681:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 219 00000100:00100000:3.0:1789181519.630692:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6a2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+62:11610:x1876092488084352:12345-192.168.204.32@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789181519.630748:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789181519.630774:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259200/0x8f4f7840b2e4202d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f389 expref: 62 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181519.630809:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9dc1995b7b00) 00010000:00010000:3.0:1789181519.630821:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789181519.630919:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e4203b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181519.630934:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e4203b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181519.630944:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e4203b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181519.630961:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e42042 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xad28fd7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181519.630969:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e42042 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xad28fd7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181519.630975:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e42042 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xad28fd7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181519.631126:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e4203b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181519.631136:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e4203b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181519.631142:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e4203b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181519.631148:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1bfa1fa00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:3.0:1789181519.631153:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e4203b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181519.631168:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e4203b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181519.631177:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9dc1995b7800) 00010000:00010000:3.0:1789181519.631180:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181519.631184:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e4203b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181519.631190:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e4203b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181519.631201:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e42042 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xad28fd7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181519.631207:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e42042 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xad28fd7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181519.631212:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e42042 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xad28fd7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181519.631217:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1bfa1ee00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:3.0:1789181519.631219:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e42042 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xad28fd7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181519.631224:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e42042 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xad28fd7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181519.631231:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xad28fd7a (ffff9dc192187600) 00010000:00010000:3.0:1789181519.631233:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181519.631236:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e42042 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xad28fd7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181519.631255:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e42042 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xad28fd7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181519.633568:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6a2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+61:11610:x1876092488084352:12345-192.168.204.32@tcp:36:lhsmtool_posix.0 Request processed in 2861us (3087us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789181519.633583:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 219 00000100:00100000:1.0:1789181519.639914:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181519.642014:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488084480 00000100:00100000:3.0:1789181519.642029:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488084480 00000100:00100000:2.0:1789181519.642189:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 220 00000100:00100000:2.0:1789181519.642201:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6c0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+61:11610:x1876092488084480:12345-192.168.204.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789181519.642220:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181519.642242:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258c00/0x8f4f7840b2e42049 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f390 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.642293:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259c00/0x8f4f7840b2e42050 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.642307:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259c00/0x8f4f7840b2e42050 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.642318:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259c00/0x8f4f7840b2e42050 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.642438:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258c00/0x8f4f7840b2e42049 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f390 expref: 63 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.642456:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259c00/0x8f4f7840b2e42050 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f390 expref: 62 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.642465:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9dc1995b7300) 00010000:00010000:2.0:1789181519.642468:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789181519.642473:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1c0259c00, rc 0) 00000100:00100000:2.0:1789181519.642538:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6c0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+62:11610:x1876092488084480:12345-192.168.204.32@tcp:101:lhsmtool_posix.0 Request processed in 339us (2635us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181519.642545:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 220 00000100:00100000:1.0:1789181519.645957:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181519.646173:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488084736 00000100:00100000:2.0:1789181519.646185:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488084736 00000100:00100000:2.0:1789181519.646256:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 221 00000100:00100000:2.0:1789181519.646266:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+62:11610:x1876092488084736:12345-192.168.204.32@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789181519.646408:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259400/0x8f4f7840b2e42057 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.646452:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259400/0x8f4f7840b2e42057 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.646466:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259400/0x8f4f7840b2e42057 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789181519.646739:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:2.0:1789181519.646749:0:5842:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 411903417145ns, next at 412903415083ns, rc = 0 00000004:00010000:2.0:1789181519.646834:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000001fe9c73 reply state 000000002e86c7d5 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259400/0x8f4f7840b2e42057 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181519.647208:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789181519.647320:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+64:11610:x1876092488084736:12345-192.168.204.32@tcp:36:lhsmtool_posix.0 Request processed in 1054us (1371us total) trans 4294967505 rc 0/0 00000100:00100000:2.0:1789181519.647352:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 221 00010000:00010000:1.0:1789181519.655979:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259400/0x8f4f7840b2e42057 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181519.656022:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259400/0x8f4f7840b2e42057 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181519.656030:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259400/0x8f4f7840b2e42057 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181519.656050:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1c0259400 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:1.0:1789181519.656055:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259400/0x8f4f7840b2e42057 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181519.656062:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259400/0x8f4f7840b2e42057 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181519.656080:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9dc1995b7300) 00010000:00010000:1.0:1789181519.656083:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789181519.656089:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259400/0x8f4f7840b2e42057 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181519.656095:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259400/0x8f4f7840b2e42057 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181519.661458:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181519.661668:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488084864 00000100:00100000:2.0:1789181519.661678:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488084864 00000100:00100000:2.0:1789181519.661743:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 222 00000100:00100000:2.0:1789181519.661753:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1ba406d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+63:11610:x1876092488084864:12345-192.168.204.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789181519.661777:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181519.661797:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258c00/0x8f4f7840b2e4205e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f397 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.661868:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258c00/0x8f4f7840b2e4205e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f397 expref: 64 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.661881:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258c00/0x8f4f7840b2e4205e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f397 expref: 64 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.661917:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9dc1995b7300) 00010000:00010000:2.0:1789181519.661921:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789181519.661924:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1c0258c00, rc 0) 00000100:00100000:2.0:1789181519.661986:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1ba406d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+64:11610:x1876092488084864:12345-192.168.204.32@tcp:101:lhsmtool_posix.0 Request processed in 233us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181519.661993:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 222 00000100:00100000:0.0:1789181519.666545:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181519.666605:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488084992 00000100:00100000:3.0:1789181519.666616:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488084992 00000100:00100000:3.0:1789181519.666713:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 63 00000100:00100000:3.0:1789181519.666726:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c02cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+9:2354:x1876092488084992:12345-192.168.204.32@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1789181519.667034:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c02cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+10:2354:x1876092488084992:12345-192.168.204.32@tcp:2:lhsmtool_posix.0 Request processed in 311us (498us total) trans 4294967320 rc 0/0 00000100:00100000:3.0:1789181519.667041:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 63 00000100:00080000:0.0:1789181519.667238:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789181519.673029:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181519.673138:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488085248 00000100:00100000:2.0:1789181519.673148:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488085248 00000100:00100000:2.0:1789181519.673211:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 60 00000100:00100000:2.0:1789181519.673222:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1ba405c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+64:11610:x1876092488085248:12345-192.168.204.32@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789181519.673495:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1ba405c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+65:11610:x1876092488085248:12345-192.168.204.32@tcp:35:lhsmtool_posix.0 Request processed in 275us (475us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1789181519.673503:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 60 00000100:00100000:1.0:1789181519.677053:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181519.677372:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488085504 00000100:00100000:2.0:1789181519.677382:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488085504 00000100:00100000:2.0:1789181519.677492:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 223 00000100:00100000:2.0:1789181519.677505:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1ba407b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+65:11610:x1876092488085504:12345-192.168.204.32@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789181519.677620:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1ba407b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+65:11610:x1876092488085504:12345-192.168.204.32@tcp:57:lhsmtool_posix.0 Request processed in 118us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181519.677628:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 223 00000100:00100000:1.0:1789181519.684122:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181519.684450:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488085632 00000100:00100000:2.0:1789181519.684530:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488085632 00000100:00100000:2.0:1789181519.684597:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 224 00000100:00100000:2.0:1789181519.684608:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1ba404380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+65:11610:x1876092488085632:12345-192.168.204.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789181519.684646:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181519.684678:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259000/0x8f4f7840b2e42065 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f39e expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.684867:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258e00/0x8f4f7840b2e4206c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.684883:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258e00/0x8f4f7840b2e4206c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.684894:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258e00/0x8f4f7840b2e4206c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789181519.684934:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789181519.684954:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258e00/0x8f4f7840b2e4206c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.684983:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259000/0x8f4f7840b2e42065 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f39e expref: 67 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.685003:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258e00/0x8f4f7840b2e4206c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f39e expref: 66 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.685012:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9dc1995b7300) 00010000:00010000:2.0:1789181519.685015:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789181519.685018:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1c0258e00, rc 0) 00000100:00100000:2.0:1789181519.685129:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1ba404380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+66:11610:x1876092488085632:12345-192.168.204.32@tcp:101:lhsmtool_posix.0 Request processed in 523us (1018us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181519.685137:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 224 00000100:00100000:1.0:1789181519.691524:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181519.692136:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488085760 00000100:00100000:2.0:1789181519.692148:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488085760 00000100:00100000:2.0:1789181519.692223:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 64 00000100:00100000:2.0:1789181519.692234:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1ba405f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+10:2353:x1876092488085760:12345-192.168.204.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789181519.692252:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181519.692284:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d217ff7/0x8f4f7840b2e42073 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f3a5 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789181519.692312:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa4be50, blocks: 0x1 00010000:00010000:2.0:1789181519.692369:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=411s v=(0 0) 00010000:00010000:2.0:1789181519.692374:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789181519.692384:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d217ff7/0x8f4f7840b2e42073 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f3a5 expref: 11 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.692406:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005d217ff7/0x8f4f7840b2e42073 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f3a5 expref: 11 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.692419:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1c0259000, rc 0) 00000100:00100000:2.0:1789181519.692705:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1ba405f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+11:2353:x1876092488085760:12345-192.168.204.32@tcp:101:lhsmtool_posix.0 Request processed in 462us (1181us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181519.692714:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 64 00000100:00100000:1.0:1789181519.696466:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181519.696607:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488086016 00000100:00100000:3.0:1789181519.696617:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488086016 00000100:00100000:3.0:1789181519.696682:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 225 00000100:00100000:3.0:1789181519.696692:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1ba405880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+66:11610:x1876092488086016:12345-192.168.204.32@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789181519.696807:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1ba405880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+66:11610:x1876092488086016:12345-192.168.204.32@tcp:57:lhsmtool_posix.0 Request processed in 116us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181519.696814:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 225 00000100:00100000:1.0:1789181519.701781:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181519.701887:0:6894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488086144 00000100:00100000:2.0:1789181519.701897:0:6894:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488086144 00000100:00100000:2.0:1789181519.701958:0:6894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 65 00000100:00100000:2.0:1789181519.701969:0:6894:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1ba405180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+11:11610:x1876092488086144:12345-192.168.204.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789181519.701989:0:6894:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181519.702021:0:6894:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f2c05bf4/0x8f4f7840b2e4207a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f3ac expref: -99 pid: 6894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.702055:0:6894:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005d217ff7/0x8f4f7840b2e42073 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f3a5 expref: 12 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.702064:0:6894:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789181519.702068:0:6894:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789181519.702074:0:6894:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2c05bf4/0x8f4f7840b2e4207a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f3ac expref: 12 pid: 6894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.702107:0:6894:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005d217ff7/0x8f4f7840b2e42073 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f3a5 expref: 12 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.702119:0:6894:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005d217ff7/0x8f4f7840b2e42073 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f3a5 expref: 12 pid: 6691 timeout: 511 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181519.702132:0:6894:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b66f7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:6894:1876092510091136:192.168.204.32@tcp:104: 00000100:00100000:2.0:1789181519.702419:0:6894:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc0821f4600 going to sleep for 11 seconds 00000100:00100000:1.0:1789181519.705521:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181519.705610:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488086272 00000100:00100000:0.0:1789181519.705618:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488086272 00010000:00010000:0.0:1789181519.705682:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005d217ff7/0x8f4f7840b2e42073 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f3a5 expref: 13 pid: 6691 timeout: 511 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181519.705731:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 81 00000100:00100000:0.0:1789181519.705741:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1ba404700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+13:2354:x1876092488086272:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789181519.705756:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789181519.705781:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005d217ff7/0x8f4f7840b2e42073 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f3a5 expref: 13 pid: 6691 timeout: 511 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181519.705795:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005d217ff7/0x8f4f7840b2e42073 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f3a5 expref: 13 pid: 6691 timeout: 511 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181519.705820:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789181519.705824:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789181519.705833:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f2c05bf4/0x8f4f7840b2e4207a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f3ac expref: 13 pid: 6894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181519.705844:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2c05bf4/0x8f4f7840b2e4207a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f3ac expref: 13 pid: 6894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181519.705892:0:5827:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f2c05bf4/0x8f4f7840b2e4207a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f3ac expref: 13 pid: 6894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181519.705906:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6a2ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5827:1876092510091264:192.168.204.32@tcp:105: 00000100:00100000:0.0:1789181519.705984:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1ba4b99c0 going to sleep for 11 seconds 00010000:00010000:2.0:1789181519.706246:0:6894:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d217ff7/0x8f4f7840b2e42073 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f3a5 expref: 13 pid: 6691 timeout: 511 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181519.706406:0:6894:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b66f7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:6894:1876092510091136:192.168.204.32@tcp:104: 00010000:00010000:2.0:1789181519.706433:0:6894:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f2c05bf4/0x8f4f7840b2e4207a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f3ac expref: 12 pid: 6894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.706527:0:6894:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1c0258400, rc 0) 00000100:00100000:2.0:1789181519.706562:0:6894:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1ba405180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+12:11610:x1876092488086144:12345-192.168.204.32@tcp:101:lhsmtool_posix.0 Request processed in 4594us (4790us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181519.706570:0:6894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 65 00000100:00100000:1.0:1789181519.712906:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181519.713024:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6a2ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5827:1876092510091264:192.168.204.32@tcp:105: 00010000:00010000:0.0:1789181519.713056:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789181519.713113:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1ba404700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+11:2354:x1876092488086272:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 7372us (7662us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181519.713123:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 81 00000100:00100000:2.0:1789181519.715135:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488086400 00000100:00100000:2.0:1789181519.715148:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488086400 00002000:00100000:2.0:1789181519.715207:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff9dc1ba405500 x1876092488086400/t0(0) o4->5971a429-48ca-4c07-88a3-fa58102a53bc@192.168.204.32@tcp:650/0 lens 504/0 e 0 to 0 dl 1789181530 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789181519.715219:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9dc1ba405500 with x1876092488086400 ext(0->12) 00002000:00010000:2.0:1789181519.715225:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9dc1ba405500 00000100:00100000:2.0:1789181519.715251:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 7 00000100:00100000:2.0:1789181519.715261:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1ba405500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+11:2354:x1876092488086400:12345-192.168.204.32@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789181519.716636:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1ba405500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+13:2354:x1876092488086400:12345-192.168.204.32@tcp:4:lhsmtool_posix.0 Request processed in 1370us (3731us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1789181519.716648:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 7 00002000:00100000:2.0:1789181519.716668:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff9dc1ba405500 x1876092488086400/t4294967321(0) o4->5971a429-48ca-4c07-88a3-fa58102a53bc@192.168.204.32@tcp:650/0 lens 504/448 e 0 to 0 dl 1789181530 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789181519.716685:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9dc1ba405500 with x1876092488086400 ext(0->12) 00002000:00010000:2.0:1789181519.716690:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9dc1ba405500 00000100:00100000:3.0:1789181519.719421:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181519.719570:0:6887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488086528 00000100:00100000:2.0:1789181519.719581:0:6887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488086528 00000100:00100000:2.0:1789181519.719644:0:6887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 226 00000100:00100000:2.0:1789181519.719666:0:6887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c0268000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+66:11610:x1876092488086528:12345-192.168.204.32@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1789181519.810826:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967489 is committed 00000020:00080000:1.0:1789181519.810864:0:5865:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9dc1add2c780 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1789181519.810869:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9dc1a734dc00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9dc1add2c300 00000020:00080000:1.0:1789181519.810873:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9dc1a734d400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9dc1a7079c00 00000020:00080000:1.0:1789181519.810899:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 6 committed batchid 5 00000020:00080000:1.0:1789181519.811082:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000001:00080000:1.0:1789181519.811097:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967502 is committed 00000004:00080000:1.0:1789181519.811105:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:1.0:1789181519.811118:0:5865:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9dc08311d240 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1789181519.811121:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9dc1c0266200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9dc08311d180 00000020:00080000:1.0:1789181519.811124:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9dc1c0266900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9dc1bfbe4800 00000100:00100000:1.0:1789181519.811232:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1ba406680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876092510091392:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789181519.811298:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181519.811404:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510091392 00000100:00100000:1.0:1789181519.811412:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510091392 00000100:00100000:1.0:1789181519.811458:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789181519.811466:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1ba407480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876092510091392:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789181519.811492:0:6692:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:1.0:1789181519.811524:0:6692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aa4be4f, atime: 0x6aa4be4f, ctime: 0x6aa4be4f, blocks: 0xb 00010000:00010000:1.0:1789181519.811533:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005993d51a/0x8f4f7840b2e42081 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181519.811551:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=412s v=(0 0) 00010000:00010000:1.0:1789181519.811556:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789181519.811562:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005993d51a/0x8f4f7840b2e42081 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181519.811597:0:6692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005993d51a/0x8f4f7840b2e42081 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181519.811609:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005993d51a/0x8f4f7840b2e42081 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181519.811617:0:6692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005993d51a/0x8f4f7840b2e42081 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181519.811634:0:6692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789181519.812091:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1ba407480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3304:x1876092510091392:12345-0@lo:6:osp-syn-0-0.0 Request processed in 625us (792us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1789181519.812099:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00010000:1.0:1789181519.812128:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789181519.812134:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005993d51a/0x8f4f7840b2e42081 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181519.812143:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc18151ac00 already unused, calling callback (ffffffffc152f9b0) 00010000:00010000:1.0:1789181519.812147:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005993d51a/0x8f4f7840b2e42081 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181519.812156:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005993d51a/0x8f4f7840b2e42081 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181519.812174:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005993d51a/0x8f4f7840b2e42081 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181519.812189:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005993d51a/0x8f4f7840b2e42081 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181519.812209:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181519.812211:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181519.812213:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181519.812243:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:1.0:1789181519.812248:0:3304:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967309 00000004:00080000:1.0:1789181519.812267:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9dc1c026fb80, transno 4294967307 00000004:00080000:1.0:1789181519.812277:0:3304:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967309 00000100:00100000:1.0:1789181519.812292:0:3304:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9dc1ba406680 x1876092510091392/t4294967310(4294967310) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789181535 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1789181519.812303:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9dc1ba406680/2, rc 0, transno 4294967310 00000100:00100000:1.0:1789181519.812308:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1ba406680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876092510091392:0@lo:6:osp-syn-0-0.0 00000020:00080000:1.0:1789181519.812550:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:1.0:1789181519.812577:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000001:00080000:1.0:1789181519.812602:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:1.0:1789181519.812610:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000004:00080000:1.0:1789181519.812665:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000100:00100000:1.0:1789181519.812774:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1ba404000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510091520:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789181519.812812:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181519.812837:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789181519.812843:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1ba406a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510091648:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789181519.812865:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181519.812896:0:6894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510091520 00000100:00100000:1.0:1789181519.812908:0:6894:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510091520 00000100:00100000:1.0:1789181519.812949:0:6894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510091648 00000100:00100000:1.0:1789181519.812952:0:6894:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510091648 00000100:00100000:1.0:1789181519.812969:0:6894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789181519.812976:0:6894:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1ba407100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3305:x1876092510091520:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1789181519.812994:0:6894:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:1.0:1789181519.813016:0:6894:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d37720bf/0x8f4f7840b2e42088 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181519.813034:0:6894:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000019f80116/0x8f4f7840b2e41e43 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f30b expref: 12 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181519.813043:0:6894:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1789181519.813047:0:6894:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789181519.813051:0:6894:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d37720bf/0x8f4f7840b2e42088 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181519.813075:0:6894:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000019f80116/0x8f4f7840b2e41e43 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f30b expref: 12 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181519.813090:0:6894:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000019f80116/0x8f4f7840b2e41e43 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f30b expref: 12 pid: 6693 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181519.813103:0:6894:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1ba404e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:6894:1876092510091776:192.168.204.32@tcp:104: 00000100:00100000:1.0:1789181519.813164:0:6894:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc08311d180 going to sleep for 11 seconds 00000100:00080000:1.0:1789181519.813177:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789181519.813287:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789181519.813301:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1ba406300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3305:x1876092510091648:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1789181519.813441:0:6691:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1789181519.813445:0:6691:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1789181520 00002000:00010000:1.0:1789181519.813447:0:6691:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789181519.813450:0:6691:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1789181520 -> 1789181520 00002000:00010000:1.0:1789181519.813452:0:6691:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1789181519.813489:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1ba406300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3305:x1876092510091648:12345-0@lo:2:osp-syn-1-0.0 Request processed in 189us (623us total) trans 4294967322 rc 0/0 00000100:00100000:1.0:1789181519.813496:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000004:00080000:1.0:1789181519.813528:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9dc1ba406a00/2, rc 0, transno 4294967322 00000100:00100000:1.0:1789181519.813532:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1ba406a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510091648:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1789181519.814613:0:6887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c0268000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+20:11610:x1876092488086528:12345-192.168.204.32@tcp:44:lhsmtool_posix.0 Request processed in 94955us (95197us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181519.814624:0:6887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 226 00000100:00100000:3.0:1789181519.821296:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181519.822101:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488086656 00000100:00100000:1.0:1789181519.822114:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488086656 00000100:00100000:2.0:1789181519.823187:0:6894:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1ba404e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:6894:1876092510091776:192.168.204.32@tcp:104: 00010000:00010000:2.0:1789181519.823221:0:6894:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d37720bf/0x8f4f7840b2e42088 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181519.823476:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181519.823621:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488086784 00000100:00100000:3.0:1789181519.823642:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488086784 00010000:00010000:3.0:1789181519.823699:0:6707:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000019f80116/0x8f4f7840b2e41e43 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f30b expref: 14 pid: 6693 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181519.823780:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 82 00000100:00100000:3.0:1789181519.823791:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1ba407800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+14:2353:x1876092488086784:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789181519.823808:0:6707:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789181519.823814:0:6707:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000019f80116/0x8f4f7840b2e41e43 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f30b expref: 14 pid: 6693 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181519.823826:0:6707:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000019f80116/0x8f4f7840b2e41e43 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f30b expref: 14 pid: 6693 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181519.823854:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000019f80116/0x8f4f7840b2e41e43 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f30b expref: 14 pid: 6693 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181519.823872:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789181519.823876:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789181519.823881:0:6707:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d37720bf/0x8f4f7840b2e42088 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181519.823891:0:6707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d37720bf/0x8f4f7840b2e42088 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181519.823925:0:6707:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789181519.823982:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1ba407800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+13:2353:x1876092488086784:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 192us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181519.823999:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 82 00010000:00010000:1.0:1789181519.824102:0:6894:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d37720bf/0x8f4f7840b2e42088 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181519.824128:0:6894:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d37720bf/0x8f4f7840b2e42088 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181519.824138:0:6894:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d37720bf/0x8f4f7840b2e42088 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181519.824146:0:6894:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d37720bf/0x8f4f7840b2e42088 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181519.824165:0:6894:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789181519.825037:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 69 00000100:00100000:0.0:1789181519.825048:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c0268380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+12:2353:x1876092488086656:12345-192.168.204.32@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1789181519.825473:0:6894:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1ba407100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3305:x1876092510091520:12345-0@lo:6:osp-syn-1-0.0 Request processed in 12495us (12658us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1789181519.825481:0:6894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00010000:1.0:1789181519.825505:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789181519.825511:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d37720bf/0x8f4f7840b2e42088 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181519.825522:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc18151a000 already unused, calling callback (ffffffffc152f9b0) 00010000:00010000:1.0:1789181519.825526:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d37720bf/0x8f4f7840b2e42088 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181519.825537:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d37720bf/0x8f4f7840b2e42088 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181519.825555:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d37720bf/0x8f4f7840b2e42088 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181519.825562:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d37720bf/0x8f4f7840b2e42088 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181519.825582:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181519.825584:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181519.825586:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789181519.825621:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9dc1ba404000/2, rc 0, transno 4294967323 00000100:00100000:1.0:1789181519.825628:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1ba404000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510091520:0@lo:6:osp-syn-1-0.0 00000001:00080000:3.0:1789181519.870537:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967319 is committed 00000001:00080000:3.0:1789181519.870556:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000001:00080000:3.0:1789181519.870563:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000100:00100000:2.0:1789181519.870853:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c0268380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+7:2353:x1876092488086656:12345-192.168.204.32@tcp:16:lhsmtool_posix.0 Request processed in 45794us (49552us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181519.870865:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 69 00000100:00100000:1.0:1789181519.875961:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181519.876477:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488087040 00000100:00100000:3.0:1789181519.876493:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488087040 00000100:00100000:3.0:1789181519.876611:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 227 00000100:00100000:3.0:1789181519.876626:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1ba404a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+20:11610:x1876092488087040:12345-192.168.204.32@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789181519.876707:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789181519.876741:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258e00/0x8f4f7840b2e4206c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f39e expref: 20 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181519.876765:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9dc1995b7300) 00010000:00010000:3.0:1789181519.876772:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789181519.876812:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e4208f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181519.876839:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e4208f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181519.876850:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e4208f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789181519.877175:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006f5958f5 reply state 00000000dffca121 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e4208f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181519.877185:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789181519.877303:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1ba404a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+21:11610:x1876092488087040:12345-192.168.204.32@tcp:36:lhsmtool_posix.0 Request processed in 681us (1352us total) trans 4294967507 rc 0/0 00000100:00100000:3.0:1789181519.878101:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 227 00000100:00100000:0.0:1789181519.889132:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181519.890135:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488087168 00000100:00100000:1.0:1789181519.890164:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488087168 00000100:00100000:1.0:1789181519.890237:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 70 00000100:00100000:1.0:1789181519.890248:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6a2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+7:2353:x1876092488087168:12345-192.168.204.32@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789181519.890996:0:6692:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1789181519.891002:0:6692:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1789181520 -> 1789181520 00002000:00010000:1.0:1789181519.891004:0:6692:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1789181519 00002000:00010000:1.0:1789181519.891006:0:6692:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1789181520 -> 1789181520 00002000:00010000:1.0:1789181519.891009:0:6692:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1789181519.891086:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6a2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+8:2353:x1876092488087168:12345-192.168.204.32@tcp:2:lhsmtool_posix.0 Request processed in 839us (1963us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1789181519.891094:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 70 00010000:00010000:3.0:1789181519.898321:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e4208f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181519.898365:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e4208f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181519.898373:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e4208f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181519.898379:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1bfa1fa00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:3.0:1789181519.898384:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e4208f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181519.898392:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e4208f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181519.898409:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9dc1995b7300) 00010000:00010000:3.0:1789181519.898412:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181519.898417:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e4208f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181519.898422:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fa00/0x8f4f7840b2e4208f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181519.901163:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181519.901276:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488087424 00000100:00100000:2.0:1789181519.901286:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488087424 00000100:00100000:2.0:1789181519.901386:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 228 00000100:00100000:2.0:1789181519.901397:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6a29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+20:11610:x1876092488087424:12345-192.168.204.32@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1789181519.901465:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258e00/0x8f4f7840b2e42096 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.901481:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259c00/0x8f4f7840b2e42050 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f390 expref: 20 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.901489:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258e00/0x8f4f7840b2e42096 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.901524:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259c00/0x8f4f7840b2e42050 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f390 expref: 20 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.901538:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259c00/0x8f4f7840b2e42050 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f390 expref: 20 pid: 5844 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181519.901552:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b66f7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1876092510091904:192.168.204.32@tcp:104: 00000100:00100000:2.0:1789181519.901665:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc186dab000 going to sleep for 11 seconds 00000100:00100000:0.0:1789181519.907366:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181519.907505:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488087552 00000100:00100000:1.0:1789181519.907515:0:8456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488087552 00010000:00010000:1.0:1789181519.907553:0:8456:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259c00/0x8f4f7840b2e42050 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f390 expref: 21 pid: 5844 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181519.907601:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 83 00000100:00100000:1.0:1789181519.907611:0:8456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6a28a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5971a429-48ca-4c07-88a3-fa58102a53bc+21:2353:x1876092488087552:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789181519.907625:0:8456:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789181519.907632:0:8456:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259c00/0x8f4f7840b2e42050 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f390 expref: 21 pid: 5844 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181519.907645:0:8456:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259c00/0x8f4f7840b2e42050 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f390 expref: 21 pid: 5844 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181519.907676:0:8456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9dc1995b7300) 00010000:00010000:1.0:1789181519.907682:0:8456:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258e00/0x8f4f7840b2e42096 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181519.907714:0:8456:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258e00/0x8f4f7840b2e42096 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181519.907721:0:8456:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258e00/0x8f4f7840b2e42096 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181519.907742:0:8456:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789181519.907799:0:8456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6a28a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5971a429-48ca-4c07-88a3-fa58102a53bc+21:2353:x1876092488087552:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 188us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181519.907806:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 83 00010000:00010000:2.0:1789181519.908822:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259c00/0x8f4f7840b2e42050 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f390 expref: 20 pid: 5844 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181519.908918:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b66f7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1876092510091904:192.168.204.32@tcp:104: 00010000:00010000:2.0:1789181519.908941:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258e00/0x8f4f7840b2e42096 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.908952:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258e00/0x8f4f7840b2e42096 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.908959:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258e00/0x8f4f7840b2e42096 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.908990:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258e00/0x8f4f7840b2e42096 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.908997:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258e00/0x8f4f7840b2e42096 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.909005:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258e00/0x8f4f7840b2e42096 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.909011:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1c0258e00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:2.0:1789181519.909016:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258e00/0x8f4f7840b2e42096 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.909024:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258e00/0x8f4f7840b2e42096 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.909040:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9dc1995b7300) 00010000:00010000:2.0:1789181519.909076:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1789181519.909082:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258e00/0x8f4f7840b2e42096 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.909089:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258e00/0x8f4f7840b2e42096 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181519.909170:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6a29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+19:11610:x1876092488087424:12345-192.168.204.32@tcp:55:lhsmtool_posix.0 Request processed in 7775us (8016us total) trans 0 rc -22/-22 00000100:00100000:2.0:1789181519.909179:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 228 00000100:00100000:0.0:1789181519.914000:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181519.914568:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488087680 00000100:00100000:1.0:1789181519.914581:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488087680 00000100:00100000:1.0:1789181519.914682:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 71 00000100:00100000:1.0:1789181519.914702:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189809c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+8:2354:x1876092488087680:12345-192.168.204.32@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789181519.914748:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000059f46ab8/0x8f4f7840b2e4209d lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181519.914769:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f2c05bf4/0x8f4f7840b2e4207a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f3ac expref: 8 pid: 6894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181519.914778:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789181519.914782:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789181519.914786:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059f46ab8/0x8f4f7840b2e4209d lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181519.914821:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f2c05bf4/0x8f4f7840b2e4207a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f3ac expref: 8 pid: 6894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181519.914965:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f2c05bf4/0x8f4f7840b2e4207a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f3ac expref: 8 pid: 6894 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181519.914981:0:6693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1ba404e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6693:1876092510092032:192.168.204.32@tcp:104: 00000100:00100000:1.0:1789181519.915078:0:6693:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc08311d180 going to sleep for 11 seconds 00000100:00100000:3.0:1789181519.918065:0:6693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1ba404e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6693:1876092510092032:192.168.204.32@tcp:104: 00010000:00010000:3.0:1789181519.918094:0:6693:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000059f46ab8/0x8f4f7840b2e4209d lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181519.919617:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181519.920375:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488087808 00000100:00100000:1.0:1789181519.920387:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488087808 00010000:00010000:1.0:1789181519.920432:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f2c05bf4/0x8f4f7840b2e4207a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f3ac expref: 9 pid: 6894 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181519.920521:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 84 00000100:00100000:1.0:1789181519.920533:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc18980bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+9:2354:x1876092488087808:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789181519.920549:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789181519.920576:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f2c05bf4/0x8f4f7840b2e4207a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f3ac expref: 9 pid: 6894 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181519.920590:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f2c05bf4/0x8f4f7840b2e4207a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f3ac expref: 9 pid: 6894 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181519.920618:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2c05bf4/0x8f4f7840b2e4207a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f3ac expref: 9 pid: 6894 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181519.920637:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789181519.920642:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789181519.920674:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000059f46ab8/0x8f4f7840b2e4209d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181519.920683:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059f46ab8/0x8f4f7840b2e4209d lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181519.920720:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789181519.920770:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc18980bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+8:2354:x1876092488087808:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 239us (1159us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181519.920778:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 84 00010000:00010000:0.0:1789181519.920935:0:6693:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000059f46ab8/0x8f4f7840b2e4209d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181519.920945:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000059f46ab8/0x8f4f7840b2e4209d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181519.920970:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000059f46ab8/0x8f4f7840b2e4209d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181519.920978:0:6693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000059f46ab8/0x8f4f7840b2e4209d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181519.920999:0:6693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000059f46ab8/0x8f4f7840b2e4209d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181519.921006:0:6693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc18151ae00 already unused, calling callback (ffffffffc152f9b0) 00010000:00010000:0.0:1789181519.921010:0:6693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000059f46ab8/0x8f4f7840b2e4209d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181519.921019:0:6693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000059f46ab8/0x8f4f7840b2e4209d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181519.921031:0:6693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000059f46ab8/0x8f4f7840b2e4209d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181519.921039:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000059f46ab8/0x8f4f7840b2e4209d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181519.921102:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189809c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+7:2354:x1876092488087680:12345-192.168.204.32@tcp:1:lhsmtool_posix.0 Request processed in 6410us (7111us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181519.921126:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 71 00000100:00100000:0.0:1789181519.927275:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181519.927542:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488088064 00000100:00100000:2.0:1789181519.927553:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488088064 00000100:00100000:2.0:1789181519.927638:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 229 00000100:00100000:2.0:1789181519.927649:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189808380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+19:11610:x1876092488088064:12345-192.168.204.32@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789181519.927796:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258e00/0x8f4f7840b2e420a4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.927814:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258e00/0x8f4f7840b2e420a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.927926:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258e00/0x8f4f7840b2e420a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.928142:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259c00/0x8f4f7840b2e420ab lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.928154:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258c00/0x8f4f7840b2e4205e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f397 expref: 20 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.928163:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259c00/0x8f4f7840b2e420ab lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.928209:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258c00/0x8f4f7840b2e4205e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f397 expref: 20 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.929174:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258c00/0x8f4f7840b2e4205e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f397 expref: 20 pid: 5844 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181519.929191:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b66f7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1876092510092160:192.168.204.32@tcp:104: 00000100:00100000:0.0:1789181519.929600:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc186dab000 going to sleep for 11 seconds 00000100:00100000:0.0:1789181519.933544:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181519.933613:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488088192 00000100:00100000:3.0:1789181519.933636:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488088192 00010000:00010000:3.0:1789181519.933685:0:6707:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258c00/0x8f4f7840b2e4205e lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f397 expref: 21 pid: 5844 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181519.933734:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 85 00000100:00100000:3.0:1789181519.933745:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189809f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+21:2353:x1876092488088192:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789181519.933760:0:6707:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789181519.933767:0:6707:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258c00/0x8f4f7840b2e4205e lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f397 expref: 21 pid: 5844 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181519.933780:0:6707:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258c00/0x8f4f7840b2e4205e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f397 expref: 21 pid: 5844 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181519.933802:0:6707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9dc1995b7300) 00010000:00010000:3.0:1789181519.933807:0:6707:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259c00/0x8f4f7840b2e420ab lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181519.933817:0:6707:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259c00/0x8f4f7840b2e420ab lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181519.933834:0:6707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259c00/0x8f4f7840b2e420ab lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181519.933855:0:6707:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789181519.934197:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189809f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+21:2353:x1876092488088192:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 454us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181519.934206:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 85 00010000:00010000:1.0:1789181519.936436:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258c00/0x8f4f7840b2e4205e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f397 expref: 20 pid: 5844 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181519.936458:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b66f7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1876092510092160:192.168.204.32@tcp:104: 00010000:00010000:1.0:1789181519.936480:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259c00/0x8f4f7840b2e420ab lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181519.936490:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259c00/0x8f4f7840b2e420ab lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181519.936497:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259c00/0x8f4f7840b2e420ab lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789181519.936800:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:1.0:1789181519.937573:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:1.0:1789181519.937791:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:1.0:1789181519.938009:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1ba404e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5842:1876092510092288:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789181519.938073:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181519.938164:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc08311d600 going to sleep for 11 seconds 00000100:00100000:3.0:1789181519.938489:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510092288 00000100:00100000:3.0:1789181519.938498:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510092288 00000100:00100000:3.0:1789181519.938609:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789181519.938620:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c026fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5842:x1876092510092288:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789181519.938760:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c026fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5842:x1876092510092288:12345-0@lo:1000:mdt00_000.0 Request processed in 142us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181519.938767:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789181519.939064:0:5842:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967323 gen 2 00000004:00080000:1.0:1789181519.939070:0:5842:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967323 00000004:00080000:1.0:1789181519.939095:0:5842:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9dc1ba406a00, transno 4294967322 00000004:00080000:1.0:1789181519.939114:0:5842:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9dc1ba404000, transno 4294967323 00000100:00100000:1.0:1789181519.939122:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1ba404e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5842:1876092510092288:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1789181519.940067:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:1.0:1789181519.940143:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1ba404e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5842:1876092510092416:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789181519.940206:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181519.941086:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc08311d3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789181519.941142:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510092416 00000100:00100000:2.0:1789181519.941149:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510092416 00000100:00100000:2.0:1789181519.941187:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789181519.941196:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6e5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5842:x1876092510092416:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789181519.941425:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6e5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5842:x1876092510092416:12345-0@lo:1000:mdt00_000.0 Request processed in 229us (1218us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1789181519.941433:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789181519.941636:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1ba404e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5842:1876092510092416:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1789181519.941683:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259c00/0x8f4f7840b2e420ab lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181519.941705:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259c00/0x8f4f7840b2e420ab lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181519.941713:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259c00/0x8f4f7840b2e420ab lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181519.941719:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1c0259c00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:1.0:1789181519.941723:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259c00/0x8f4f7840b2e420ab lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181519.941730:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259c00/0x8f4f7840b2e420ab lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181519.941744:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9dc1995b7300) 00010000:00010000:1.0:1789181519.941747:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789181519.941753:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259c00/0x8f4f7840b2e420ab lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181519.941773:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259c00/0x8f4f7840b2e420ab lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181519.941803:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259e00/0x8f4f7840b2e41fee lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181519.941808:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259e00/0x8f4f7840b2e41fee lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181519.941814:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259e00/0x8f4f7840b2e41fee lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181519.941819:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1c0259e00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:1.0:1789181519.941822:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259e00/0x8f4f7840b2e41fee lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181519.941838:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259e00/0x8f4f7840b2e41fee lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181519.941847:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9dc192187700) 00010000:00010000:1.0:1789181519.941849:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789181519.941855:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258000/0x8f4f7840b2e41ff5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f37b expref: 23 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181519.941867:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258000/0x8f4f7840b2e41ff5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f37b expref: 23 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181519.941877:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258000/0x8f4f7840b2e41ff5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f37b expref: 23 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181519.942090:0:5842:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258000/0x8f4f7840b2e41ff5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f37b expref: 23 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181519.942103:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6e5ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1876092510092544:192.168.204.32@tcp:105: 00000100:00100000:1.0:1789181519.942176:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc08311d3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789181519.945372:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181519.945524:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488088320 00000100:00100000:3.0:1789181519.945532:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488088320 00000100:00100000:3.0:1789181519.945582:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 61 00000100:00100000:3.0:1789181519.945591:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6e5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+24:11609:x1876092488088320:12345-192.168.204.32@tcp:49:lfs.0 00000100:00100000:2.0:1789181519.945840:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6e5ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1876092510092544:192.168.204.32@tcp:105: 00010000:00010000:2.0:1789181519.945867:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259e00/0x8f4f7840b2e41fee lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.945876:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259e00/0x8f4f7840b2e41fee lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.945906:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259a00/0x8f4f7840b2e420b2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.945919:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259a00/0x8f4f7840b2e420b2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.945929:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259a00/0x8f4f7840b2e420b2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.945952:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259a00/0x8f4f7840b2e420b2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.945959:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259a00/0x8f4f7840b2e420b2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.945965:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259a00/0x8f4f7840b2e420b2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.945972:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1c0259a00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:2.0:1789181519.945976:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259a00/0x8f4f7840b2e420b2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.945984:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259a00/0x8f4f7840b2e420b2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.945995:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9dc192187700) 00010000:00010000:2.0:1789181519.945998:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789181519.946001:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259a00/0x8f4f7840b2e420b2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.946007:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0259a00/0x8f4f7840b2e420b2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.946015:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258e00/0x8f4f7840b2e420a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.946020:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258e00/0x8f4f7840b2e420a4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.946025:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258e00/0x8f4f7840b2e420a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.946035:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1c0258e00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:2.0:1789181519.946038:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258e00/0x8f4f7840b2e420a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.946043:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258e00/0x8f4f7840b2e420a4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.946051:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9dc192187700) 00010000:00010000:2.0:1789181519.946053:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789181519.946056:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258e00/0x8f4f7840b2e420a4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181519.946061:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258e00/0x8f4f7840b2e420a4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789181519.946489:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789181519.946493:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789181519.947098:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1789181519.947107:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789181519.947494:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6e5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+24:11609:x1876092488088320:12345-192.168.204.32@tcp:49:lfs.0 Request processed in 1900us (2127us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181519.947503:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 61 00000100:00100000:2.0:1789181519.947567:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189808380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+23:11610:x1876092488088064:12345-192.168.204.32@tcp:57:lhsmtool_posix.0 Request processed in 19920us (20513us total) trans 4294967512 rc 0/0 00000100:00100000:2.0:1789181519.947576:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 229 00000020:00080000:2.0:1789181519.947580:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1789181519.955099:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181519.955180:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181519.955440:0:6887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488088832 00000100:00100000:0.0:1789181519.955451:0:6887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488088832 00000100:00100000:0.0:1789181519.955541:0:6887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 230 00000100:00100000:0.0:1789181519.955569:0:6887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b66f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+23:11609:x1876092488088832:12345-192.168.204.32@tcp:58:lfs.0 00000040:00080000:0.0:1789181519.955960:0:6887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:0.0:1789181519.956102:0:6887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b66f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+23:11609:x1876092488088832:12345-192.168.204.32@tcp:58:lfs.0 Request processed in 535us (920us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181519.956121:0:6887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 230 00000100:00100000:1.0:1789181519.956189:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488088576 00000100:00100000:1.0:1789181519.956195:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488088576 00000100:00100000:1.0:1789181519.956237:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 62 00000100:00100000:1.0:1789181519.956245:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19928dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+23:11610:x1876092488088576:12345-192.168.204.32@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1789181519.956779:0:5846:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789181519.956891:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:1.0:1789181519.956938:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b600/0x8f4f7840b2e420b9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181519.956954:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b600/0x8f4f7840b2e420b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181519.956967:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b600/0x8f4f7840b2e420b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181519.956976:0:5846:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b600/0x8f4f7840b2e420b9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181519.956994:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b600/0x8f4f7840b2e420b9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181519.957000:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b600/0x8f4f7840b2e420b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181519.957019:0:5846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789181519.957078:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19928dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+25:11610:x1876092488088576:12345-192.168.204.32@tcp:35:lhsmtool_posix.0 Request processed in 833us (1987us total) trans 4294967514 rc 0/0 00000100:00100000:1.0:1789181519.957085:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 62 00000020:00080000:1.0:1789181519.957089:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789181519.957143:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789181519.957149:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b600/0x8f4f7840b2e420b9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181519.957156:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc18151b600 already unused, calling callback (ffffffffc152f9b0) 00010000:00010000:1.0:1789181519.957160:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b600/0x8f4f7840b2e420b9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181519.957168:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b600/0x8f4f7840b2e420b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181519.957181:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9dc18a6c2e00) 00010000:00010000:1.0:1789181519.957184:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789181519.957189:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b600/0x8f4f7840b2e420b9 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181519.957195:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b600/0x8f4f7840b2e420b9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181519.957228:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181519.957231:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181519.957232:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181519.960057:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181519.960166:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181519.960262:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181519.960289:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488089088 00000100:00100000:1.0:1789181519.960298:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488089088 00000100:00100000:1.0:1789181519.960388:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 91 00000100:00100000:1.0:1789181519.960398:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6e5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+5:2354:x1876092488089088:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:1.0:1789181519.960464:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6e5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+5:2354:x1876092488089088:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 67us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181519.960471:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 91 00000100:00100000:2.0:1789181519.960934:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488089216 00000100:00100000:2.0:1789181519.960940:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488089216 00000100:00100000:2.0:1789181519.960988:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 155 00000100:00100000:2.0:1789181519.960997:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6e5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7badad21-a177-49b1-a2af-7b11e28c02ce+5:2354:x1876092488089216:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:2.0:1789181519.961037:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6e5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7badad21-a177-49b1-a2af-7b11e28c02ce+5:2354:x1876092488089216:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 42us (870us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181519.961043:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 155 00000100:00080000:2.0:1789181519.962419:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789181519.967370:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488088960 00000100:00100000:0.0:1789181519.967387:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488088960 00000100:00100000:1.0:1789181519.967570:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 296 00000100:00100000:1.0:1789181519.967581:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:975a0591-a8f7-4a74-9f93-a5aa77f2315c+13:2354:x1876092488088960:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:1.0:1789181519.967672:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:975a0591-a8f7-4a74-9f93-a5aa77f2315c+13:2354:x1876092488088960:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 92us (7623us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181519.967680:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 296 00000100:00100000:2.0:1789181520.001832:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181520.001987:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488089344 00000100:00100000:0.0:1789181520.001998:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488089344 00000100:00100000:0.0:1789181520.002075:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 231 00000100:00100000:0.0:1789181520.002086:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1ba405c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+25:11612:x1876092488089344:12345-192.168.204.32@tcp:101:lfs.0 00010000:00010000:0.0:1789181520.002125:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181520.002146:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891c00/0x8f4f7840b2e420c0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f3b3 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181520.002220:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891600/0x8f4f7840b2e420c7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181520.002235:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891600/0x8f4f7840b2e420c7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181520.002246:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891600/0x8f4f7840b2e420c7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181520.002262:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890e00/0x8f4f7840b2e420ce lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181520.002269:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890e00/0x8f4f7840b2e420ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181520.002295:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890e00/0x8f4f7840b2e420ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181520.003186:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891a00/0x8f4f7840b2e420d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181520.003202:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ec00/0x8f4f7840b2e41fe0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f374 expref: 26 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181520.003271:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891a00/0x8f4f7840b2e420d5 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181520.003509:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ec00/0x8f4f7840b2e41fe0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f374 expref: 26 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181520.003526:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ec00/0x8f4f7840b2e41fe0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f374 expref: 26 pid: 5843 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181520.003541:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc189809880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1876092510092672:192.168.204.32@tcp:104: 00000100:00080000:2.0:1789181520.003631:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789181520.004621:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1ba4b9000 going to sleep for 11 seconds 00000100:00100000:1.0:1789181520.010194:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181520.010521:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc189809880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1876092510092672:192.168.204.32@tcp:104: 00010000:00010000:3.0:1789181520.010548:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891a00/0x8f4f7840b2e420d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181520.010787:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488089600 00000100:00100000:0.0:1789181520.010796:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488089600 00000100:00100000:1.0:1789181520.011033:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 63 00000100:00100000:1.0:1789181520.011044:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6e5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+27:5592:x1876092488089600:12345-192.168.204.32@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789181520.011486:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6e5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+28:5592:x1876092488089600:12345-192.168.204.32@tcp:35:ldlm_bl.0 Request processed in 442us (1299us total) trans 4294967515 rc 0/0 00000100:00100000:1.0:1789181520.011495:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 63 00000100:00100000:1.0:1789181520.014674:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181520.014898:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488089728 00000100:00100000:3.0:1789181520.014909:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488089728 00010000:00010000:3.0:1789181520.014951:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ec00/0x8f4f7840b2e41fe0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f374 expref: 28 pid: 5843 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181520.015036:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 86 00000100:00100000:3.0:1789181520.015047:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19619e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+28:2353:x1876092488089728:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789181520.015064:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789181520.015071:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ec00/0x8f4f7840b2e41fe0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f374 expref: 28 pid: 5843 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181520.015099:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ec00/0x8f4f7840b2e41fe0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f374 expref: 28 pid: 5843 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181520.015135:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ec00/0x8f4f7840b2e41fe0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f374 expref: 28 pid: 5843 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181520.015151:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9dc192187700) 00010000:00010000:3.0:1789181520.015156:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891a00/0x8f4f7840b2e420d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181520.015165:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891a00/0x8f4f7840b2e420d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181520.015172:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891a00/0x8f4f7840b2e420d5 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181520.015204:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789181520.015313:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891a00/0x8f4f7840b2e420d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181520.015322:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891a00/0x8f4f7840b2e420d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789181520.015396:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1789181520.015401:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789181520.015430:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891a00/0x8f4f7840b2e420d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181520.015444:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891a00/0x8f4f7840b2e420d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181520.015454:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891600/0x8f4f7840b2e420c7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181520.015461:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891600/0x8f4f7840b2e420c7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181520.015467:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891600/0x8f4f7840b2e420c7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181520.015473:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc189891600 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:0.0:1789181520.015476:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891600/0x8f4f7840b2e420c7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181520.015484:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891600/0x8f4f7840b2e420c7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181520.015493:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9dc1995b7800) 00010000:00010000:0.0:1789181520.015496:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789181520.015499:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891600/0x8f4f7840b2e420c7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181520.015504:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891600/0x8f4f7840b2e420c7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181520.015514:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890e00/0x8f4f7840b2e420ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181520.015520:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890e00/0x8f4f7840b2e420ce lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181520.015532:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890e00/0x8f4f7840b2e420ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181520.015537:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc189890e00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:0.0:1789181520.015540:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890e00/0x8f4f7840b2e420ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181520.015546:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890e00/0x8f4f7840b2e420ce lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181520.015553:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9dc18553ab00) 00010000:00010000:0.0:1789181520.015556:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789181520.015558:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890e00/0x8f4f7840b2e420ce lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181520.015564:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890e00/0x8f4f7840b2e420ce lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181520.015612:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891c00/0x8f4f7840b2e420c0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f3b3 expref: 28 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181520.015625:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891a00/0x8f4f7840b2e420d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f3b3 expref: 27 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181520.015632:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9dc192187700) 00010000:00010000:0.0:1789181520.015634:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789181520.015637:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc189891a00, rc 0) 00000100:00100000:0.0:1789181520.015710:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1ba405c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+27:11612:x1876092488089344:12345-192.168.204.32@tcp:101:lfs.0 Request processed in 13626us (13899us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181520.015727:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 231 00000100:00100000:3.0:1789181520.016063:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19619e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+26:2353:x1876092488089728:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 1016us (1482us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181520.016071:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 86 00010000:00010000:1.0:1789181520.448528:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789181520.842950:0:12574:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789181520.842959:0:12574:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789181520.843086:0:12574:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1789181520.843093:0:12574:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789181520.895548:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1ba406a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:880710ad-110c-42a4-a174-ab1b99a7ebeb:3303:1876092510092800:0@lo:400:kworker.0 00000100:00100000:1.0:1789181520.895624:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181520.895743:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1ba404000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876092510092928:0@lo:400:kworker.0 00000100:00100000:3.0:1789181520.895777:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181520.895898:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c01b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876092510093440:0@lo:400:kworker.0 00000100:00100000:3.0:1789181520.895930:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181520.896068:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c01b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1876092510093312:0@lo:400:kworker.0 00000100:00100000:1.0:1789181520.896089:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181520.896128:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1ba404700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1876092510093056:0@lo:400:kworker.0 00000100:00100000:1.0:1789181520.896150:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181520.896262:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789181520.896269:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1ba407800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510093184:0@lo:400:kworker.0 00000100:00100000:1.0:1789181520.896290:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181520.897082:0:6887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510092928 00000100:00100000:1.0:1789181520.897092:0:6887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510092928 00000100:00100000:3.0:1789181520.897241:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510093312 00000100:00100000:3.0:1789181520.897247:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510093312 00000100:00100000:3.0:1789181520.897307:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789181520.897318:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6e5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876092510093312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181520.897787:0:6887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510093056 00000100:00100000:1.0:1789181520.897792:0:6887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510093056 00000100:00100000:1.0:1789181520.897894:0:6887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789181520.897903:0:6887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c0269180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876092510092928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181520.898085:0:6887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c0269180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876092510092928:12345-0@lo:400:kworker.0 Request processed in 182us (2304us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181520.898093:0:6887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789181520.898255:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6e5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876092510093312:12345-0@lo:400:kworker.0 Request processed in 939us (2163us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181520.898262:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789181520.898279:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789181520.898287:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6e5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876092510093056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181520.898324:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6e5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876092510093056:12345-0@lo:400:kworker.0 Request processed in 39us (2172us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181520.898349:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00080000:3.0:1789181520.898373:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789181520.898502:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510093440 00000100:00100000:1.0:1789181520.898508:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510093440 00000100:00100000:1.0:1789181520.898540:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510093184 00000100:00100000:1.0:1789181520.898543:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510093184 00000100:00100000:1.0:1789181520.898762:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789181520.898770:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c026a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3304:x1876092510093440:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789181520.898900:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789181520.898932:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c026a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3304:x1876092510093440:12345-0@lo:400:kworker.0 Request processed in 163us (3000us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181520.898945:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789181520.898959:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789181520.898966:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6e5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3305:x1876092510093184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181520.899080:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6e5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3305:x1876092510093184:12345-0@lo:400:kworker.0 Request processed in 114us (2788us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181520.899087:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789181520.899538:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510092800 00000100:00100000:2.0:1789181520.899544:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510092800 00000100:00100000:2.0:1789181520.899585:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:2.0:1789181520.899593:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:3303:x1876092510092800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181520.899651:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:3303:x1876092510092800:12345-0@lo:400:kworker.0 Request processed in 59us (4027us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181520.899657:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1789181520.900759:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1ba407800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510093184:0@lo:400:kworker.0 00000100:00100000:1.0:1789181520.900775:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1ba404700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1876092510093056:0@lo:400:kworker.0 00000100:00100000:1.0:1789181520.900891:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1ba404000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876092510092928:0@lo:400:kworker.0 00000100:00100000:1.0:1789181520.900903:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c01b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876092510093440:0@lo:400:kworker.0 00000100:00100000:1.0:1789181520.900935:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1ba406a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:880710ad-110c-42a4-a174-ab1b99a7ebeb:3303:1876092510092800:0@lo:400:kworker.0 00000100:00100000:1.0:1789181520.900947:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c01b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1876092510093312:0@lo:400:kworker.0 00000040:00080000:2.0:1789181520.959703:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789181520.959715:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789181520.959757:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1789181520.959765:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789181520.959910:0:11694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c01b2680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11694:1876092510093568:192.168.204.32@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789181520.960025:0:11694:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1879cb9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789181520.965264:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181520.965323:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488089856 00000100:00100000:1.0:1789181520.965327:0:11694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c01b2680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11694:1876092510093568:192.168.204.32@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789181520.965345:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488089856 00000100:00100000:2.0:1789181520.965396:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 232 00000100:00100000:2.0:1789181520.965404:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6e5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+26:11625:x1876092488089856:12345-192.168.204.32@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789181520.965436:0:5842:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789181520.965546:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6e5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+26:11625:x1876092488089856:12345-192.168.204.32@tcp:53:lhsmtool_posix.0 Request processed in 141us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181520.965553:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 232 00000100:00100000:1.0:1789181520.969227:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181520.970279:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488090112 00000100:00100000:0.0:1789181520.970294:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488090112 00000100:00100000:0.0:1789181520.970454:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 233 00000100:00100000:0.0:1789181520.970466:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6e5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+26:11625:x1876092488090112:12345-192.168.204.32@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789181520.970494:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181520.970523:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891600/0x8f4f7840b2e420dc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f3ba expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181520.970631:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890a00/0x8f4f7840b2e420e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181520.970657:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890a00/0x8f4f7840b2e420e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181520.970682:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890a00/0x8f4f7840b2e420e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789181520.970695:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1789181520.970842:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891600/0x8f4f7840b2e420dc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f3ba expref: 29 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181520.970859:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890a00/0x8f4f7840b2e420e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f3ba expref: 28 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181520.970867:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9dc192187700) 00010000:00010000:0.0:1789181520.970870:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789181520.970874:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc189890a00, rc 0) 00000100:00100000:0.0:1789181520.971008:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6e5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+28:11625:x1876092488090112:12345-192.168.204.32@tcp:101:lhsmtool_posix.0 Request processed in 545us (1788us total) trans 4294967516 rc 0/0 00000100:00100000:0.0:1789181520.971016:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 233 00000100:00100000:3.0:1789181520.976582:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181520.976623:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488090240 00000100:00100000:3.0:1789181520.976644:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488090240 00000100:00100000:3.0:1789181520.976724:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 18 00000100:00100000:3.0:1789181520.976735:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c026b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+28:2352:x1876092488090240:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789181520.976748:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789181520.976772:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890a00/0x8f4f7840b2e420e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f3ba expref: 28 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181520.976792:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9dc192187700) 00010000:00010000:3.0:1789181520.976798:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789181520.976869:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c026b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+27:2352:x1876092488090240:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 136us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181520.976876:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 18 00000100:00100000:3.0:1789181520.981260:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181520.981401:0:6887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488090496 00000100:00100000:1.0:1789181520.981412:0:6887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488090496 00000100:00100000:1.0:1789181520.981464:0:6887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 234 00000100:00100000:1.0:1789181520.981475:0:6887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c026a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+27:11625:x1876092488090496:12345-192.168.204.32@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789181520.981560:0:6887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e420f1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181520.981595:0:6887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e420f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181520.981607:0:6887:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e420f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181520.981860:0:6887:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e420f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181520.981869:0:6887:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e420f1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181520.981876:0:6887:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e420f1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181520.981881:0:6887:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc18151ae00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:1.0:1789181520.981886:0:6887:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e420f1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181520.981894:0:6887:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e420f1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181520.981907:0:6887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9dc192187700) 00010000:00010000:1.0:1789181520.981910:0:6887:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789181520.981915:0:6887:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e420f1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181520.981921:0:6887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ae00/0x8f4f7840b2e420f1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6887 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181520.982081:0:6887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c026a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+28:11625:x1876092488090496:12345-192.168.204.32@tcp:57:lhsmtool_posix.0 Request processed in 607us (832us total) trans 4294967517 rc 0/0 00000100:00100000:1.0:1789181520.982096:0:6887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 234 00000040:00080000:1.0:1789181520.983234:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789181520.983241:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789181520.983765:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1789181520.983775:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789181520.989545:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181520.989618:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488090752 00000100:00100000:3.0:1789181520.989628:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488090752 00000100:00100000:3.0:1789181520.989715:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 64 00000100:00100000:3.0:1789181520.989729:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6e5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+28:11625:x1876092488090752:12345-192.168.204.32@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789181520.989983:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6e5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+29:11625:x1876092488090752:12345-192.168.204.32@tcp:35:lhsmtool_posix.0 Request processed in 257us (445us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1789181520.989991:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 64 00000100:00100000:2.0:1789181521.406689:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789181521.408396:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c0269880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876092510093696:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789181521.408476:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181521.409965:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510093696 00000100:00100000:0.0:1789181521.409979:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510093696 00000100:00100000:0.0:1789181521.410058:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789181521.410071:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c01b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1876092510093696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789181521.410108:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789181521.410173:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c01b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1876092510093696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (1696us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181521.410193:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:3.0:1789181521.410301:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789181521.412271:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c0269880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876092510093696:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789181521.470744:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181522.494511:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789181522.656829:0:12625:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789181522.656838:0:12625:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789181522.656879:0:12625:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1789181522.656884:0:12625:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789181522.954070:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181522.957526:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488091008 00000100:00100000:1.0:1789181522.957541:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488091008 00000100:00100000:1.0:1789181522.957619:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 235 00000100:00100000:1.0:1789181522.957635:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c0269880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+29:11645:x1876092488091008:12345-192.168.204.32@tcp:101:lfs.0 00010000:00010000:1.0:1789181522.957659:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181522.957677:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ac00/0x8f4f7840b2e420f8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f3c1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181522.957770:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b600/0x8f4f7840b2e420ff lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181522.957785:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b600/0x8f4f7840b2e420ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181522.957798:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b600/0x8f4f7840b2e420ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789181522.957810:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1789181522.958169:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151ac00/0x8f4f7840b2e420f8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f3c1 expref: 32 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181522.958199:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b600/0x8f4f7840b2e420ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f3c1 expref: 31 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181522.958208:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9dc192187700) 00010000:00010000:1.0:1789181522.958211:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789181522.958214:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc18151b600, rc 0) 00000100:00100000:1.0:1789181522.958276:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c0269880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+31:11645:x1876092488091008:12345-192.168.204.32@tcp:101:lfs.0 Request processed in 648us (4215us total) trans 4294967519 rc 0/0 00000100:00100000:1.0:1789181522.958283:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 235 00000100:00080000:1.0:1789181522.958447:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789181522.964777:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181522.964809:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488091136 00000100:00100000:2.0:1789181522.964818:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488091136 00000100:00100000:2.0:1789181522.964865:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 236 00000100:00100000:2.0:1789181522.964875:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c01b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+31:11645:x1876092488091136:12345-192.168.204.32@tcp:54:lfs.0 00010000:00010000:2.0:1789181522.964945:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258a00/0x8f4f7840b2e4210d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181522.964963:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258a00/0x8f4f7840b2e4210d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181522.964975:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258a00/0x8f4f7840b2e4210d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181522.965000:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258a00/0x8f4f7840b2e4210d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181522.965007:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258a00/0x8f4f7840b2e4210d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181522.965015:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258a00/0x8f4f7840b2e4210d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181522.965021:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1c0258a00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:2.0:1789181522.965025:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258a00/0x8f4f7840b2e4210d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181522.965032:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258a00/0x8f4f7840b2e4210d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181522.965042:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9dc192187700) 00010000:00010000:2.0:1789181522.965045:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789181522.965069:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258a00/0x8f4f7840b2e4210d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181522.965076:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258a00/0x8f4f7840b2e4210d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181522.965140:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c01b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+31:11645:x1876092488091136:12345-192.168.204.32@tcp:54:lfs.0 Request processed in 266us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181522.965147:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 236 00000100:00100000:1.0:1789181523.138061:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181523.138158:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488091264 00000100:00100000:0.0:1789181523.138170:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488091264 00000100:00100000:0.0:1789181523.138262:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 72 00000100:00100000:0.0:1789181523.138273:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6e5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+7:2354:x1876092488091264:12345-192.168.204.32@tcp:101:cat.0 00010000:00010000:0.0:1789181523.138489:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181523.138512:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b969b5e/0x8f4f7840b2e42114 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f3c8 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789181523.138541:0:6693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6aa4be50, atime: 0x6aa4be4f, ctime: 0x6aa4be50, blocks: 0xb 00010000:00010000:0.0:1789181523.138561:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=415s v=(0 0) 00010000:00010000:0.0:1789181523.138565:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789181523.138575:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b969b5e/0x8f4f7840b2e42114 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f3c8 expref: 8 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181523.138603:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004b969b5e/0x8f4f7840b2e42114 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f3c8 expref: 8 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181523.138726:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc189891000, rc 0) 00000100:00100000:0.0:1789181523.138815:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6e5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+8:2354:x1876092488091264:12345-192.168.204.32@tcp:101:cat.0 Request processed in 544us (762us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181523.138823:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 72 00000100:00080000:1.0:1789181523.139388:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789181523.157562:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181523.166586:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488091392 00000100:00100000:1.0:1789181523.166611:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488091392 00002000:00100000:1.0:1789181523.166685:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff9dc1c01b0000 x1876092488091392/t0(0) o3->5971a429-48ca-4c07-88a3-fa58102a53bc@192.168.204.32@tcp:654/0 lens 488/0 e 0 to 0 dl 1789181534 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789181523.166697:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9dc1c01b0000 with x1876092488091392 ext(0->4095) 00002000:00010000:1.0:1789181523.166704:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9dc1c01b0000 00000100:00100000:1.0:1789181523.166730:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 8 00000100:00100000:1.0:1789181523.166740:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c01b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+8:2353:x1876092488091392:12345-192.168.204.32@tcp:3:cat.0 00000100:00100000:1.0:1789181523.166952:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c01b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+8:2353:x1876092488091392:12345-192.168.204.32@tcp:3:cat.0 Request processed in 213us (9399us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1789181523.166959:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 8 00002000:00100000:1.0:1789181523.166966:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff9dc1c01b0000 x1876092488091392/t0(0) o3->5971a429-48ca-4c07-88a3-fa58102a53bc@192.168.204.32@tcp:654/0 lens 488/4536 e 0 to 0 dl 1789181534 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789181523.166992:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9dc1c01b0000 with x1876092488091392 ext(0->4095) 00002000:00010000:1.0:1789181523.166996:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9dc1c01b0000 00010000:00010000:1.0:1789181523.518562:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181523.968215:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789181523.968237:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc189809180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510093824:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789181523.968301:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181523.968393:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510093824 00000100:00100000:0.0:1789181523.968401:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510093824 00000100:00100000:0.0:1789181523.968458:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789181523.968468:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189808700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1876092510093824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789181523.968501:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789181523.968558:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189808700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1876092510093824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181523.968565:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:0.0:1789181523.968600:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789181523.968634:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc189809180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510093824:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789181524.542701:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789181524.551646:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:3.0:1789181525.046283:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:3.0:1789181525.046300:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967325 is committed 00000001:00080000:2.0:1789181525.047199:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967516 is committed 00000001:00080000:3.0:1789181525.047527:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:3.0:1789181525.047551:0:5865:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9dc08311d600 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1789181525.047567:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9dc1bfa04200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9dc08311dd80 00000020:00080000:3.0:1789181525.047571:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9dc1bfa04b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9dc1a707e800 00000020:00080000:3.0:1789181525.047591:0:5865:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:3.0:1789181525.047597:0:5865:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 6 batchid updated 00000020:00080000:1.0:1789181525.047686:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:1.0:1789181525.047880:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:2.0:1789181525.080946:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181525.081040:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488091520 00000100:00100000:0.0:1789181525.081051:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488091520 00000100:00100000:0.0:1789181525.081108:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 298 00000100:00100000:0.0:1789181525.081120:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:975a0591-a8f7-4a74-9f93-a5aa77f2315c+13:2354:x1876092488091520:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:0.0:1789181525.081190:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:975a0591-a8f7-4a74-9f93-a5aa77f2315c+13:2354:x1876092488091520:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 72us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181525.081198:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 298 00000100:00100000:0.0:1789181525.081662:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181525.081693:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181525.081720:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181525.081740:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181525.082232:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488091776 00000100:00100000:2.0:1789181525.082238:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488091776 00000100:00100000:2.0:1789181525.082293:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488091904 00000100:00100000:2.0:1789181525.082297:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488091904 00000100:00100000:2.0:1789181525.082319:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 94 00000100:00100000:2.0:1789181525.082327:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189809180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+5:2354:x1876092488091776:12345-192.168.204.32@tcp:400:kworker.0 00000100:00080000:0.0:1789181525.082351:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789181525.082356:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789181525.082372:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 95 00000100:00100000:0.0:1789181525.082382:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc18980b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+7:2354:x1876092488091904:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:0.0:1789181525.082430:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc18980b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+7:2354:x1876092488091904:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 51us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181525.082436:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 95 00000100:00100000:2.0:1789181525.082519:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189809180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+5:2354:x1876092488091776:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 193us (858us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181525.082526:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 94 00000100:00100000:1.0:1789181525.082534:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488092032 00000100:00100000:1.0:1789181525.082539:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488092032 00000100:00100000:1.0:1789181525.082599:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488091648 00000100:00100000:1.0:1789181525.082602:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488091648 00000100:00100000:1.0:1789181525.082626:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 159 00000100:00100000:1.0:1789181525.082633:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189809500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7badad21-a177-49b1-a2af-7b11e28c02ce+5:2354:x1876092488092032:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:1.0:1789181525.082662:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189809500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7badad21-a177-49b1-a2af-7b11e28c02ce+5:2354:x1876092488092032:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 29us (968us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181525.082668:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 159 00000100:00100000:1.0:1789181525.082680:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 160 00000100:00100000:1.0:1789181525.082686:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc18980a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+18:2354:x1876092488091648:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:1.0:1789181525.082710:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc18980a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+18:2354:x1876092488091648:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 24us (989us total) trans 0 rc 0/0 00000100:00080000:0.0:1789181525.082716:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789181525.082717:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 160 00010000:00010000:2.0:1789181525.566540:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181526.014745:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c01b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1876092510094208:0@lo:400:kworker.0 00000100:00100000:2.0:1789181526.014819:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181526.014887:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789181526.014895:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c01b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510094336:0@lo:400:kworker.0 00000100:00100000:2.0:1789181526.014923:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181526.014975:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510094208 00000100:00100000:2.0:1789181526.014982:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510094208 00000100:00100000:2.0:1789181526.015049:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789181526.015058:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c071df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876092510094208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181526.015297:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c071df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876092510094208:12345-0@lo:400:kworker.0 Request processed in 240us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181526.015305:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789181526.015420:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510094336 00000100:00100000:2.0:1789181526.015424:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510094336 00000100:00100000:2.0:1789181526.015456:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789181526.015463:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c071c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510094336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181526.015498:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c071c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510094336:12345-0@lo:400:kworker.0 Request processed in 35us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181526.015503:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:2.0:1789181526.015520:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789181526.015524:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789181526.015562:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:2.0:1789181526.015567:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9dc1ba406680, transno 4294967310 00000100:00100000:2.0:1789181526.015591:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c01b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510094336:0@lo:400:kworker.0 00000100:00100000:2.0:1789181526.015604:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c01b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1876092510094208:0@lo:400:kworker.0 00000100:00100000:0.0:1789181526.017045:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c01b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876092510094080:0@lo:400:kworker.0 00000100:00100000:0.0:1789181526.017102:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181526.017134:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c071ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876092510094592:0@lo:400:kworker.0 00000100:00100000:0.0:1789181526.017158:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181526.017187:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789181526.017194:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c01b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:880710ad-110c-42a4-a174-ab1b99a7ebeb:3304:1876092510093952:0@lo:400:kworker.0 00000100:00100000:0.0:1789181526.017221:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181526.017253:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c01b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1876092510094464:0@lo:400:kworker.0 00000100:00100000:0.0:1789181526.017276:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181526.017310:0:6887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510094080 00000100:00100000:0.0:1789181526.017316:0:6887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510094080 00000100:00100000:0.0:1789181526.017390:0:6887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510094464 00000100:00100000:0.0:1789181526.017393:0:6887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510094464 00000100:00100000:0.0:1789181526.017423:0:6887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789181526.017431:0:6887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189808000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876092510094080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181526.017491:0:6887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189808000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876092510094080:12345-0@lo:400:kworker.0 Request processed in 61us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181526.017498:0:6887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789181526.017516:0:6887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789181526.017524:0:6887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc18980b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876092510094464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181526.017565:0:6887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc18980b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876092510094464:12345-0@lo:400:kworker.0 Request processed in 41us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181526.017571:0:6887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789181526.017590:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510093952 00000100:00100000:0.0:1789181526.017594:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510093952 00000100:00100000:0.0:1789181526.017619:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1789181526.017625:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:3304:x1876092510093952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181526.017652:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:3304:x1876092510093952:12345-0@lo:400:kworker.0 Request processed in 28us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181526.017659:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00080000:0.0:1789181526.017689:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789181526.017711:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c01b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:880710ad-110c-42a4-a174-ab1b99a7ebeb:3304:1876092510093952:0@lo:400:kworker.0 00000100:00100000:0.0:1789181526.017723:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c01b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1876092510094464:0@lo:400:kworker.0 00000100:00100000:0.0:1789181526.017730:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c01b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876092510094080:0@lo:400:kworker.0 00000100:00100000:2.0:1789181526.018996:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510094592 00000100:00100000:2.0:1789181526.019489:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510094592 00000100:00100000:2.0:1789181526.019568:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789181526.019588:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc18980aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876092510094592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181526.019668:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc18980aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876092510094592:12345-0@lo:400:kworker.0 Request processed in 92us (2508us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181526.019674:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789181526.019725:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:2.0:1789181526.019731:0:3304:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:2.0:1789181526.019754:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c071ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876092510094592:0@lo:400:kworker.0 00000100:00080000:0.0:1789181526.020092:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789181526.534028:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789181526.534050:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfb7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876092510094720:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789181526.534126:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181526.534283:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510094720 00000100:00100000:3.0:1789181526.534291:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510094720 00000100:00100000:3.0:1789181526.534377:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789181526.534387:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc18980a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876092510094720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789181526.534423:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789181526.534468:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc18980a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876092510094720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181526.534475:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789181526.534520:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfb7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876092510094720:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789181526.590521:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181527.625631:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789181528.126575:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789181528.126584:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789181528.126878:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:2.0:1789181528.126885:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789181528.422320:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181528.422478:0:6887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488092160 00000100:00100000:0.0:1789181528.422488:0:6887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488092160 00000100:00100000:0.0:1789181528.422632:0:6887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 237 00000100:00100000:0.0:1789181528.422644:0:6887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c071ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+18:11298:x1876092488092160:12345-192.168.204.32@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1789181528.422744:0:6887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c071ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5971a429-48ca-4c07-88a3-fa58102a53bc+18:11298:x1876092488092160:12345-192.168.204.32@tcp:60:lhsmtool_posix.0 Request processed in 103us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181528.422751:0:6887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 237 00000100:00100000:3.0:1789181528.428915:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181528.429021:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488092416 00000100:00100000:1.0:1789181528.429031:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488092416 00000100:00100000:1.0:1789181528.429099:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 65 00000100:00100000:1.0:1789181528.429120:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+18:11298:x1876092488092416:12345-192.168.204.32@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789181528.429507:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+19:11298:x1876092488092416:12345-192.168.204.32@tcp:35:lhsmtool_posix.0 Request processed in 397us (601us total) trans 4294967520 rc 0/0 00000100:00100000:1.0:1789181528.429515:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 65 00000100:00080000:2.0:1789181528.430426:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789181528.641974:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181529.086885:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789181529.086911:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc189808e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510094848:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789181529.086982:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181529.087747:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510094848 00000100:00100000:0.0:1789181529.087757:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510094848 00000100:00100000:0.0:1789181529.087833:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789181529.087845:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c071e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510094848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789181529.087881:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789181529.087935:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c071e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510094848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (953us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181529.087941:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:2.0:1789181529.088110:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789181529.090715:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc189808e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510094848:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789181529.662759:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789181530.184261:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:2.0:1789181530.184277:0:5865:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:0.0:1789181530.184615:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:0.0:1789181530.184626:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:3.0:1789181530.206702:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181530.206745:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181530.206762:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488092544 00000100:00100000:0.0:1789181530.206775:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488092544 00000100:00100000:3.0:1789181530.206780:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181530.206810:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181530.206832:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 300 00000100:00100000:3.0:1789181530.206847:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181530.206848:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c371c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:975a0591-a8f7-4a74-9f93-a5aa77f2315c+13:2353:x1876092488092544:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:0.0:1789181530.206933:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c371c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:975a0591-a8f7-4a74-9f93-a5aa77f2315c+13:2353:x1876092488092544:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 90us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181530.206941:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 300 00000100:00100000:0.0:1789181530.206975:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488093056 00000100:00100000:0.0:1789181530.206979:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488093056 00000100:00100000:0.0:1789181530.207022:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488092672 00000100:00100000:0.0:1789181530.207026:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488092672 00000100:00100000:0.0:1789181530.207052:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 164 00000100:00100000:0.0:1789181530.207068:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7badad21-a177-49b1-a2af-7b11e28c02ce+5:2353:x1876092488093056:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:0.0:1789181530.207127:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7badad21-a177-49b1-a2af-7b11e28c02ce+5:2353:x1876092488093056:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 61us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181530.207135:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 164 00000100:00100000:0.0:1789181530.207149:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 165 00000100:00100000:0.0:1789181530.207156:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+18:2353:x1876092488092672:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:0.0:1789181530.207187:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+18:2353:x1876092488092672:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 32us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181530.207194:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 165 00000100:00080000:0.0:1789181530.207218:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789181530.207441:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488092800 00000100:00100000:2.0:1789181530.207446:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488092800 00000100:00100000:2.0:1789181530.207504:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488092928 00000100:00100000:2.0:1789181530.207508:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488092928 00000100:00100000:2.0:1789181530.207539:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 98 00000100:00100000:2.0:1789181530.207546:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+5:2353:x1876092488092800:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:2.0:1789181530.207587:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+5:2353:x1876092488092800:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 37us (838us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181530.207594:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 98 00000100:00100000:2.0:1789181530.207608:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 99 00000100:00100000:2.0:1789181530.207615:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1baadea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+7:2353:x1876092488092928:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:2.0:1789181530.207642:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1baadea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+7:2353:x1876092488092928:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 28us (800us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181530.207656:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 99 00000100:00080000:0.0:1789181530.207903:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789181530.207907:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789181530.687317:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789181530.745657:0:12829:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 22:52:10 (1789181530) 00000100:00100000:1.0:1789181531.134941:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c01b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1876092510095232:0@lo:400:kworker.0 00000100:00100000:1.0:1789181531.135025:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181531.135083:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789181531.135091:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c01b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510095360:0@lo:400:kworker.0 00000100:00100000:1.0:1789181531.135128:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181531.136078:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c01b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:880710ad-110c-42a4-a174-ab1b99a7ebeb:3303:1876092510094976:0@lo:400:kworker.0 00000100:00100000:0.0:1789181531.136135:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181531.136172:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c01b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1876092510095488:0@lo:400:kworker.0 00000100:00100000:0.0:1789181531.136196:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181531.136218:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789181531.136224:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c01b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876092510095104:0@lo:400:kworker.0 00000100:00100000:0.0:1789181531.136244:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181531.136260:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1ba769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876092510095616:0@lo:400:kworker.0 00000100:00100000:0.0:1789181531.136280:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181531.136308:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510094976 00000100:00100000:0.0:1789181531.136316:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510094976 00000100:00100000:0.0:1789181531.136566:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1789181531.136577:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c370450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:3303:x1876092510094976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181531.137080:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c370450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:3303:x1876092510094976:12345-0@lo:400:kworker.0 Request processed in 503us (942us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181531.137088:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1789181531.137200:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c01b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:880710ad-110c-42a4-a174-ab1b99a7ebeb:3303:1876092510094976:0@lo:400:kworker.0 00000100:00100000:0.0:1789181531.137271:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510095232 00000100:00100000:0.0:1789181531.137276:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510095232 00000100:00100000:0.0:1789181531.137370:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510095488 00000100:00100000:0.0:1789181531.137374:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510095488 00000100:00100000:2.0:1789181531.137434:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510095104 00000100:00100000:2.0:1789181531.137449:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510095104 00000100:00100000:2.0:1789181531.137470:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1789181531.137487:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6e5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876092510095232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181531.137535:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6e5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876092510095232:12345-0@lo:400:kworker.0 Request processed in 58us (2509us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181531.137541:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1789181531.137554:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1789181531.137561:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189808a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876092510095104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181531.137591:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189808a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876092510095104:12345-0@lo:400:kworker.0 Request processed in 32us (1347us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181531.137597:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1789181531.137628:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510095360 00000100:00100000:2.0:1789181531.137632:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510095360 00000100:00080000:3.0:1789181531.139122:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789181531.139143:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789181531.139194:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c01b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876092510095104:0@lo:400:kworker.0 00000100:00100000:3.0:1789181531.139480:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510095616 00000100:00100000:3.0:1789181531.139486:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510095616 00000100:00100000:3.0:1789181531.139543:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789181531.139553:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc18980ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1876092510095616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181531.139631:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc18980ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1876092510095616:12345-0@lo:400:kworker.0 Request processed in 79us (3349us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181531.139638:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:3.0:1789181531.139656:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789181531.139683:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c01b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1876092510095232:0@lo:400:kworker.0 00000100:00100000:3.0:1789181531.139726:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1ba769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876092510095616:0@lo:400:kworker.0 00000100:00100000:0.0:1789181531.140424:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1789181531.140434:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc18980b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876092510095488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181531.140589:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc18980b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876092510095488:12345-0@lo:400:kworker.0 Request processed in 156us (4390us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181531.140596:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1789181531.140673:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c01b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1876092510095488:0@lo:400:kworker.0 00000100:00100000:2.0:1789181531.140794:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789181531.140802:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6e5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510095360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181531.140844:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6e5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510095360:12345-0@lo:400:kworker.0 Request processed in 42us (5714us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181531.140850:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789181531.140929:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c01b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510095360:0@lo:400:kworker.0 00000100:00100000:1.0:1789181531.650578:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789181531.650601:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6e5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876092510095744:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789181531.650668:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181531.650877:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510095744 00000100:00100000:0.0:1789181531.650886:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510095744 00000100:00100000:0.0:1789181531.650941:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789181531.650951:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6e5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876092510095744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789181531.650984:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789181531.651053:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6e5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876092510095744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181531.651060:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789181531.651216:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6e5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876092510095744:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789181531.714423:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181532.735573:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789181533.012440:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181533.012514:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488093184 00000100:00100000:0.0:1789181533.012525:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488093184 00000100:00100000:0.0:1789181533.012602:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 238 00000100:00100000:0.0:1789181533.012614:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1baadce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7badad21-a177-49b1-a2af-7b11e28c02ce+5:12309:x1876092488093184:12345-192.168.204.32@tcp:101:lsof.0 00010000:00010000:0.0:1789181533.012633:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181533.012655:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890c00/0x8f4f7840b2e4211b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f3cf expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181533.012730:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891800/0x8f4f7840b2e42122 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181533.012744:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891800/0x8f4f7840b2e42122 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181533.012770:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891800/0x8f4f7840b2e42122 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789181533.012812:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789181533.012816:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789181533.013047:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891800/0x8f4f7840b2e42122 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181533.013073:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890c00/0x8f4f7840b2e4211b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f3cf expref: 7 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181533.013091:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891800/0x8f4f7840b2e42122 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f3cf expref: 6 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181533.013100:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc18a6c2a00) 00010000:00010000:0.0:1789181533.013103:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789181533.013107:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc189891800, rc 0) 00000100:00100000:0.0:1789181533.013168:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1baadce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7badad21-a177-49b1-a2af-7b11e28c02ce+6:12309:x1876092488093184:12345-192.168.204.32@tcp:101:lsof.0 Request processed in 557us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181533.013175:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 238 00000100:00080000:3.0:1789181533.013358:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789181533.759288:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181534.208192:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789181534.208215:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc189808e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510095872:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789181534.208286:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181534.208566:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510095872 00000100:00100000:0.0:1789181534.208577:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510095872 00000100:00100000:0.0:1789181534.208667:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789181534.208679:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1ba769c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510095872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789181534.208717:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789181534.208779:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1ba769c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510095872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181534.208787:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789181534.208874:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc189808e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510095872:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789181534.209223:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789181534.783647:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181534.995748:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181534.995835:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488093440 00000100:00100000:3.0:1789181534.995845:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488093440 00000100:00100000:3.0:1789181534.995922:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 66 00000100:00100000:3.0:1789181534.995934:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1ba76b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+18:12310:x1876092488093440:12345-192.168.204.32@tcp:35:umount.0 00000100:00080000:0.0:1789181534.996224:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789181534.996582:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1ba76b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+19:12310:x1876092488093440:12345-192.168.204.32@tcp:35:umount.0 Request processed in 649us (842us total) trans 4294967521 rc 0/0 00000100:00100000:3.0:1789181534.996591:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 66 00000100:00100000:2.0:1789181535.000269:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181535.000376:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488093696 00000100:00100000:3.0:1789181535.000386:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488093696 00000100:00100000:3.0:1789181535.000509:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 67 00000100:00100000:3.0:1789181535.000524:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1ba769180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+19:12310:x1876092488093696:12345-192.168.204.32@tcp:35:umount.0 00000100:00100000:3.0:1789181535.001392:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1ba769180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+20:12310:x1876092488093696:12345-192.168.204.32@tcp:35:umount.0 Request processed in 867us (1127us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1789181535.001401:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 67 00000100:00100000:0.0:1789181535.011474:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181535.011553:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488093952 00000100:00100000:2.0:1789181535.011573:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488093952 00000100:00100000:2.0:1789181535.011630:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 68 00000100:00100000:2.0:1789181535.011641:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19928c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+20:12310:x1876092488093952:12345-192.168.204.32@tcp:35:umount.0 00000100:00100000:2.0:1789181535.011876:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19928c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+21:12310:x1876092488093952:12345-192.168.204.32@tcp:35:umount.0 Request processed in 236us (411us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1789181535.011884:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 68 00000100:00100000:0.0:1789181535.019002:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181535.019100:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488094208 00000100:00100000:2.0:1789181535.019111:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488094208 00000100:00100000:2.0:1789181535.019168:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 69 00000100:00100000:2.0:1789181535.019179:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc18980bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+21:12310:x1876092488094208:12345-192.168.204.32@tcp:35:umount.0 00000100:00100000:2.0:1789181535.020678:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc18980bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5971a429-48ca-4c07-88a3-fa58102a53bc+22:12310:x1876092488094208:12345-192.168.204.32@tcp:35:umount.0 Request processed in 1495us (1680us total) trans 4294967524 rc 0/0 00000100:00100000:2.0:1789181535.020690:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 69 00000100:00100000:0.0:1789181535.028863:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181535.028911:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181535.028946:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181535.029189:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488094336 00000100:00100000:2.0:1789181535.029199:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488094336 00000100:00100000:1.0:1789181535.029224:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488094592 00000100:00100000:1.0:1789181535.029231:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488094592 00000100:00100000:2.0:1789181535.029386:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488094464 00000100:00100000:2.0:1789181535.029391:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488094464 00000100:00100000:1.0:1789181535.029966:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 19 00000100:00100000:1.0:1789181535.029978:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189809f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:975a0591-a8f7-4a74-9f93-a5aa77f2315c+15:2354:x1876092488094336:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789181535.030011:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789181535.030031:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc1c2044e00/0x8f4f7840b2e411a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91ef61 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181535.030065:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789181535.030123:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189809f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:975a0591-a8f7-4a74-9f93-a5aa77f2315c+14:2354:x1876092488094336:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 148us (1269us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181535.030132:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 19 00000100:00100000:1.0:1789181535.030153:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 20 00000100:00100000:1.0:1789181535.030159:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189809880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:975a0591-a8f7-4a74-9f93-a5aa77f2315c+13:2354:x1876092488094592:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789181535.030168:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789181535.030455:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc1ba785200/0x8f4f7840b2e41392 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f02c expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181535.030465:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789181535.030489:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189809880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:975a0591-a8f7-4a74-9f93-a5aa77f2315c+12:2354:x1876092488094592:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 330us (1578us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181535.030495:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 20 00000100:00100000:1.0:1789181535.030511:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 21 00000100:00100000:1.0:1789181535.030519:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc189808e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:975a0591-a8f7-4a74-9f93-a5aa77f2315c+11:2354:x1876092488094464:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789181535.030529:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789181535.030538:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc18151b000/0x8f4f7840b2e4110e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91ef29 expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181535.030547:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789181535.030566:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc189808e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:975a0591-a8f7-4a74-9f93-a5aa77f2315c+10:2354:x1876092488094464:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 48us (1619us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181535.030759:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 21 00000100:00100000:1.0:1789181535.035934:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181535.036377:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488094976 00000100:00100000:3.0:1789181535.036388:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488094976 00000100:00100000:3.0:1789181535.036459:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 73 00000100:00100000:3.0:1789181535.036470:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6e5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+7:2350:x1876092488094976:12345-192.168.204.32@tcp:9:umount.0 00000020:00000080:3.0:1789181535.036517:0:6691:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8f4f7840b2e416e1 00000020:00010000:3.0:1789181535.036524:0:6691:0:(genops.c:1922:obd_stale_export_put()) Put export ffff9dc190619000: total 0 00000100:00080000:3.0:1789181535.036528:0:6691:0:(import.c:65:import_set_state_nolock()) ffff9dc19061c800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789181535.036576:0:6691:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:3.0:1789181535.036845:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6e5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5971a429-48ca-4c07-88a3-fa58102a53bc+5:2350:x1876092488094976:12345-192.168.204.32@tcp:9:umount.0 Request processed in 377us (921us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181535.036853:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 73 00000020:00010000:3.0:1789181535.036875:0:5831:0:(genops.c:1908:obd_stale_export_get()) Get export ffff9dc190619000: total 0 00010000:00010000:3.0:1789181535.036895:0:5831:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9dc190619000, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1789181535.036944:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b969b5e/0x8f4f7840b2e42114 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f3c8 expref: 4 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181535.036978:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cf918e38/0x8f4f7840b2e41a84 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f201 expref: 3 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181535.036992:0:5831:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9dc190619000, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1789181535.037003:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181535.037006:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181535.037007:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789181535.037633:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789181535.040929:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181535.040980:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488095104 00000100:00100000:2.0:1789181535.040991:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488095104 00000100:00080000:1.0:1789181535.041041:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789181535.041064:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 74 00000100:00100000:2.0:1789181535.041075:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6e5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+5:2350:x1876092488095104:12345-192.168.204.32@tcp:9:umount.0 00000020:00000080:2.0:1789181535.041118:0:6693:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8f4f7840b2e41480 00000100:00080000:2.0:1789181535.041129:0:6693:0:(import.c:65:import_set_state_nolock()) ffff9dc1c0240800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789181535.041181:0:6693:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00010000:00010000:1.0:1789181535.041228:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181535.042195:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6e5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+2:2350:x1876092488095104:12345-192.168.204.32@tcp:9:umount.0 Request processed in 1118us (1272us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181535.042213:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 74 00000100:00100000:3.0:1789181535.061729:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181535.062312:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488096128 00000100:00100000:0.0:1789181535.062323:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488096128 00000100:00100000:0.0:1789181535.062434:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 239 00000100:00100000:0.0:1789181535.062445:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c01b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+22:2350:x1876092488096128:12345-192.168.204.32@tcp:39:umount.0 00000020:00000080:0.0:1789181535.062484:0:5844:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8f4f7840b2e4111c 00000020:00010000:0.0:1789181535.062502:0:5844:0:(genops.c:1922:obd_stale_export_put()) Put export ffff9dc1ba455800: total 0 00000100:00080000:0.0:1789181535.062506:0:5844:0:(import.c:65:import_set_state_nolock()) ffff9dc1b671a800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789181535.062536:0:5844:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:0.0:1789181535.062886:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c01b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5971a429-48ca-4c07-88a3-fa58102a53bc+21:2350:x1876092488096128:12345-192.168.204.32@tcp:39:umount.0 Request processed in 442us (1321us total) trans 4294967525 rc 0/0 00000100:00100000:0.0:1789181535.062893:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 239 00000020:00010000:3.0:1789181535.063261:0:5831:0:(genops.c:1908:obd_stale_export_get()) Get export ffff9dc1ba455800: total 0 00010000:00010000:3.0:1789181535.063266:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181535.063309:0:5831:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9dc1ba455800, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1789181535.063378:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9dc192187c00) 00010000:00010000:3.0:1789181535.063382:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789181535.063392:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1e600/0x8f4f7840b2e41a45 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f1ec expref: 20 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181535.063434:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9dc192187c00) 00010000:00010000:3.0:1789181535.063436:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789181535.063441:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f000/0x8f4f7840b2e41a6f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f1fa expref: 19 pid: 6887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181535.063456:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9dc192187700) 00010000:00010000:3.0:1789181535.063458:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789181535.063462:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1c0258000/0x8f4f7840b2e41ff5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f37b expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181535.063474:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9dc192187700) 00010000:00010000:3.0:1789181535.063476:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789181535.063480:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891a00/0x8f4f7840b2e420d5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f3b3 expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181535.063493:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc18a6c2a00) 00010000:00010000:3.0:1789181535.067167:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789181535.067184:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151a600/0x8f4f7840b2e41ad8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f216 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181535.067230:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9dc1995b7200) 00010000:00010000:3.0:1789181535.067234:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789181535.067239:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890200/0x8f4f7840b2e41743 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f128 expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181535.067251:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9dc1995b7600) 00010000:00010000:3.0:1789181535.067253:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789181535.067277:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785800/0x8f4f7840b2e413e6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f03a expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181535.067298:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9dc1995b7200) 00010000:00010000:3.0:1789181535.067301:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789181535.067304:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784c00/0x8f4f7840b2e41456 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f056 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181535.067318:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9dc192187700) 00010000:00010000:3.0:1789181535.067321:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789181535.067325:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151b600/0x8f4f7840b2e420ff lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f3c1 expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181535.067377:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9dc192187c00) 00010000:00010000:3.0:1789181535.067380:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789181535.067384:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785400/0x8f4f7840b2e41965 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f1b4 expref: 11 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181535.067401:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9dc1995b7800) 00010000:00010000:3.0:1789181535.067404:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789181535.067408:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785600/0x8f4f7840b2e41af4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f21d expref: 10 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181535.067420:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9dc192187200) 00010000:00010000:3.0:1789181535.067422:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181535.067425:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f600/0x8f4f7840b2e41402 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f041 expref: 9 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181535.067438:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9dc1995b7800) 00010000:00010000:3.0:1789181535.067446:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789181535.067451:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc18151a800/0x8f4f7840b2e41dd3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f2ef expref: 8 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181535.067466:0:5831:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9dc1ba455800, canceled 13 locks, left on hash table 0. 00010000:00010000:3.0:1789181535.067501:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181535.067504:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181535.067506:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789181535.287608:0:5865:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5971a429-48ca-4c07-88a3-fa58102a53bc 00000001:00080000:0.0:1789181535.287624:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:0.0:1789181535.287643:0:5865:0:(genops.c:885:class_export_put()) final put ffff9dc1ba455800/5971a429-48ca-4c07-88a3-fa58102a53bc 00000020:00000080:0.0:1789181535.287678:0:706:0:(genops.c:844:class_export_destroy()) destroying export ffff9dc1ba455800/5971a429-48ca-4c07-88a3-fa58102a53bc for lustre-MDT0000 00000020:00000080:0.0:1789181535.287736:0:706:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9dc1b671a800 for lustre-MDT0000 00000100:00100000:1.0:1789181535.321229:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181535.321676:0:6887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488096256 00000100:00100000:3.0:1789181535.321687:0:6887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488096256 00000100:00100000:3.0:1789181535.321762:0:6887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 169 00000100:00100000:3.0:1789181535.321774:0:6887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6e5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7badad21-a177-49b1-a2af-7b11e28c02ce+6:2353:x1876092488096256:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:3.0:1789181535.321847:0:6887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6e5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7badad21-a177-49b1-a2af-7b11e28c02ce+6:2353:x1876092488096256:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 76us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181535.321854:0:6887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 169 00000100:00080000:1.0:1789181535.322135:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:0.0:1789181535.361051:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5971a429-48ca-4c07-88a3-fa58102a53bc 00000020:00000080:0.0:1789181535.361060:0:7647:0:(genops.c:885:class_export_put()) final put ffff9dc190619000/5971a429-48ca-4c07-88a3-fa58102a53bc 00000020:00000080:0.0:1789181535.361096:0:706:0:(genops.c:844:class_export_destroy()) destroying export ffff9dc190619000/5971a429-48ca-4c07-88a3-fa58102a53bc for lustre-OST0001 00000020:00000080:0.0:1789181535.361138:0:706:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9dc19061c800 for lustre-OST0001 00010000:00010000:1.0:1789181535.806665:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181536.254600:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc19c36df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876092510096384:0@lo:400:kworker.0 00000100:00100000:1.0:1789181536.254600:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfb7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1876092510096256:0@lo:400:kworker.0 00000100:00100000:0.0:1789181536.254671:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1ba769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876092510096128:0@lo:400:kworker.0 00000100:00100000:3.0:1789181536.254724:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1ba76b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:880710ad-110c-42a4-a174-ab1b99a7ebeb:3303:1876092510096000:0@lo:400:kworker.0 00000100:00100000:2.0:1789181536.261137:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181536.261280:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510096384 00000100:00100000:2.0:1789181536.261289:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510096384 00000100:00100000:2.0:1789181536.261390:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789181536.261400:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0833d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876092510096384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181536.261592:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0833d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876092510096384:12345-0@lo:400:kworker.0 Request processed in 194us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181536.261600:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789181536.261644:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc19c36df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876092510096384:0@lo:400:kworker.0 00000100:00080000:2.0:1789181536.261684:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789181536.265159:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181536.265607:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510096256 00000100:00100000:2.0:1789181536.265618:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510096256 00000100:00100000:2.0:1789181536.265684:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1789181536.265695:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6e5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876092510096256:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789181536.266166:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789181536.266564:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181536.266606:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0833d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876092510096640:0@lo:400:kworker.0 00000100:00100000:1.0:1789181536.266609:0:6887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510096128 00000100:00100000:1.0:1789181536.266614:0:6887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510096128 00000100:00100000:0.0:1789181536.266640:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181536.266651:0:6887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1789181536.266659:0:6887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c01c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876092510096128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181536.266682:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510096640 00000100:00100000:0.0:1789181536.266686:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510096640 00000100:00100000:1.0:1789181536.266707:0:6887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c01c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876092510096128:12345-0@lo:400:kworker.0 Request processed in 50us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181536.266718:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789181536.266725:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c01c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876092510096640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181536.266783:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c01c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876092510096640:12345-0@lo:400:kworker.0 Request processed in 59us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181536.266789:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:0.0:1789181536.266812:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789181536.266849:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1ba769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876092510096128:0@lo:400:kworker.0 00000100:00100000:0.0:1789181536.266860:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc0833d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876092510096640:0@lo:400:kworker.0 00000100:00100000:3.0:1789181536.266982:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181536.266994:0:6887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1789181536.267074:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc19c36c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1876092510096512:0@lo:400:kworker.0 00000100:00100000:3.0:1789181536.267104:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181536.267145:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6e5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876092510096256:12345-0@lo:400:kworker.0 Request processed in 1452us (1993us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181536.267153:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1789181536.267167:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510096512 00000100:00100000:2.0:1789181536.267170:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510096512 00000100:00100000:0.0:1789181536.267191:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510096000 00000100:00100000:0.0:1789181536.267197:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510096000 00000100:00100000:0.0:1789181536.267227:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1789181536.267235:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c372c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:3303:x1876092510096000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181536.267288:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfb7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1876092510096256:0@lo:400:kworker.0 00000100:00100000:2.0:1789181536.267319:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1789181536.267326:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c01b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876092510096512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181536.267409:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c01b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876092510096512:12345-0@lo:400:kworker.0 Request processed in 83us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181536.267523:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1789181536.267873:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c372c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:3303:x1876092510096000:12345-0@lo:400:kworker.0 Request processed in 638us (890us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181536.267881:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1789181536.267917:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1ba76b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:880710ad-110c-42a4-a174-ab1b99a7ebeb:3303:1876092510096000:0@lo:400:kworker.0 00000100:00100000:1.0:1789181536.267928:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc19c36c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1876092510096512:0@lo:400:kworker.0 00000100:00080000:3.0:1789181536.271413:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789181536.766755:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789181536.766777:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6e5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876092510096768:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789181536.766838:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181536.767265:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510096768 00000100:00100000:0.0:1789181536.767298:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510096768 00000100:00100000:0.0:1789181536.767381:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789181536.767391:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c01b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876092510096768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789181536.767427:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789181536.767486:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c01b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876092510096768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181536.767493:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789181536.767760:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6e5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876092510096768:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789181536.832299:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181537.213239:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181537.213278:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181537.213372:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181537.213448:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488096512 00000100:00100000:0.0:1789181537.213458:0:8456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488096512 00000100:00100000:0.0:1789181537.213526:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488096384 00000100:00100000:0.0:1789181537.213530:0:8456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488096384 00000100:00100000:0.0:1789181537.213554:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488096640 00000100:00100000:0.0:1789181537.213557:0:8456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488096640 00000100:00100000:0.0:1789181537.213576:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 22 00000100:00100000:0.0:1789181537.213586:0:8456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6e5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:975a0591-a8f7-4a74-9f93-a5aa77f2315c+12:2353:x1876092488096512:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789181537.213601:0:8456:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789181537.213621:0:8456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc1bfa1e200/0x8f4f7840b2e411f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91efa0 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181537.213640:0:8456:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789181537.213690:0:8456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6e5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:975a0591-a8f7-4a74-9f93-a5aa77f2315c+11:2353:x1876092488096512:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 105us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181537.213698:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 22 00000100:00100000:0.0:1789181537.213717:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 23 00000100:00100000:0.0:1789181537.213724:0:8456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6e5c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:975a0591-a8f7-4a74-9f93-a5aa77f2315c+10:2353:x1876092488096384:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789181537.213782:0:8456:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789181537.213793:0:8456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc1c2044000/0x8f4f7840b2e411ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91ef76 expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181537.213831:0:8456:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789181537.213853:0:8456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6e5c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:975a0591-a8f7-4a74-9f93-a5aa77f2315c+9:2353:x1876092488096384:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 129us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181537.213860:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 23 00000100:00100000:0.0:1789181537.213874:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 24 00000100:00100000:0.0:1789181537.213881:0:8456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19619c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:975a0591-a8f7-4a74-9f93-a5aa77f2315c+8:2353:x1876092488096640:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789181537.213889:0:8456:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789181537.213898:0:8456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc1c2045600/0x8f4f7840b2e4138b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f025 expref: 8 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181537.213907:0:8456:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789181537.213926:0:8456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19619c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:975a0591-a8f7-4a74-9f93-a5aa77f2315c+7:2353:x1876092488096640:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 45us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181537.213932:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 24 00000100:00100000:0.0:1789181537.215655:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181537.216059:0:6887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488096896 00000100:00100000:1.0:1789181537.216067:0:6887:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488096896 00000100:00100000:1.0:1789181537.216144:0:6887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 240 00000100:00100000:1.0:1789181537.216155:0:6887:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c01c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7badad21-a177-49b1-a2af-7b11e28c02ce+6:2350:x1876092488096896:12345-192.168.204.32@tcp:39:umount.0 00000020:00000080:1.0:1789181537.216209:0:6887:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8f4f7840b2e41203 00000020:00010000:1.0:1789181537.216218:0:6887:0:(genops.c:1922:obd_stale_export_put()) Put export ffff9dc1b6718800: total 0 00000100:00080000:1.0:1789181537.216223:0:6887:0:(import.c:65:import_set_state_nolock()) ffff9dc1b6719000 : changing import state from FULL to CLOSED 00000100:00080000:3.0:1789181537.216232:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00000004:1.0:1789181537.216262:0:6887:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000020:00010000:0.0:1789181537.216627:0:5830:0:(genops.c:1908:obd_stale_export_get()) Get export ffff9dc1b6718800: total 0 00010000:00010000:0.0:1789181537.216685:0:5830:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9dc1b6718800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1789181537.216715:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc18a6c2a00) 00010000:00010000:0.0:1789181537.216719:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789181537.216728:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891800/0x8f4f7840b2e42122 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f3cf expref: 5 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181537.216763:0:5830:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9dc1b6718800, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1789181537.216774:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181537.216777:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181537.216778:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181537.217233:0:6887:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c01c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7badad21-a177-49b1-a2af-7b11e28c02ce+3:2350:x1876092488096896:12345-192.168.204.32@tcp:39:umount.0 Request processed in 1078us (1582us total) trans 4294967526 rc 0/0 00000100:00100000:1.0:1789181537.217246:0:6887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 240 00000100:00100000:1.0:1789181537.259399:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181537.260165:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488097152 00000100:00100000:0.0:1789181537.260180:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488097152 00000100:00100000:0.0:1789181537.260246:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 303 00000100:00100000:0.0:1789181537.260258:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:975a0591-a8f7-4a74-9f93-a5aa77f2315c+7:2350:x1876092488097152:12345-192.168.204.32@tcp:251:umount.0 00000020:00000080:0.0:1789181537.260311:0:5836:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8f4f7840b2e410f9 00000020:00010000:0.0:1789181537.260320:0:5836:0:(genops.c:1922:obd_stale_export_put()) Put export ffff9dc1ba454800: total 0 00000100:00080000:0.0:1789181537.260367:0:5836:0:(import.c:65:import_set_state_nolock()) ffff9dc1ba457000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1789181537.261023:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:975a0591-a8f7-4a74-9f93-a5aa77f2315c+3:2350:x1876092488097152:12345-192.168.204.32@tcp:251:umount.0 Request processed in 764us (1632us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181537.261032:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 303 00000020:00010000:3.0:1789181537.267887:0:5831:0:(genops.c:1908:obd_stale_export_get()) Get export ffff9dc1ba454800: total 0 00010000:00010000:3.0:1789181537.267927:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181537.267980:0:5831:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9dc1ba454800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1789181537.268022:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc1ba784800/0x8f4f7840b2e411af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91ef68 expref: 2 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181537.268043:0:5831:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9dc1ba454800, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1789181537.268053:0:5831:0:(genops.c:885:class_export_put()) final put ffff9dc1ba454800/975a0591-a8f7-4a74-9f93-a5aa77f2315c 00010000:00010000:3.0:1789181537.268069:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181537.268071:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181537.268073:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789181537.268089:0:11922:0:(genops.c:844:class_export_destroy()) destroying export ffff9dc1ba454800/975a0591-a8f7-4a74-9f93-a5aa77f2315c for MGS 00000020:00000080:3.0:1789181537.268129:0:11922:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9dc1ba457000 for MGS 00010000:00010000:3.0:1789181537.860378:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789181538.366893:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789181538.366902:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789181538.369454:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:1.0:1789181538.369470:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1789181538.879425:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789181538.892696:0:13028:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1789181538.917614:0:13028:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1789181538.917659:0:13028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc180030a00/0x8f4f7840b2e4117e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e41185 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181538.917674:0:13028:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc180030a00/0x8f4f7840b2e4117e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f4f7840b2e41185 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181538.917681:0:13028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc180030a00/0x8f4f7840b2e4117e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x8f4f7840b2e41185 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181538.917700:0:13028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.132@tcp lock: ffff9dc180030a00/0x8f4f7840b2e4117e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x8f4f7840b2e41185 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181538.917721:0:13028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789181538.917726:0:13028:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1789181538.917749:0:13028:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789181538.917752:0:13028:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789181538.917758:0:13028:0:(pinger.c:399:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789181538.917785:0:13028:0:(import.c:65:import_set_state_nolock()) ffff9dc187aeb000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1789181538.917836:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6e5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876092510096896:0@lo:39:umount.0 00000100:00100000:2.0:1789181538.917907:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789181538.917991:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789181538.917999:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.132@tcp lock: ffff9dc180030a00/0x8f4f7840b2e4117e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x8f4f7840b2e41185 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181538.918007:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc180030a00 already unused, calling callback (ffffffffc1b45c20) 10000000:00010000:3.0:1789181538.918011:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.132@tcp lock: ffff9dc180030a00/0x8f4f7840b2e4117e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x8f4f7840b2e41185 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181538.918020:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.132@tcp lock: ffff9dc180030a00/0x8f4f7840b2e4117e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x8f4f7840b2e41185 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789181538.918038:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.132@tcp lock: ffff9dc180030a00/0x8f4f7840b2e4117e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x8f4f7840b2e41185 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789181538.918044:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789181538.918047:0:5830:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1789181538.918050:0:5830:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1789181538.918079:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.132@tcp lock: ffff9dc180030a00/0x8f4f7840b2e4117e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x8f4f7840b2e41185 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181538.918086:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789181538.918103:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.132@tcp lock: ffff9dc180030a00/0x8f4f7840b2e4117e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x8f4f7840b2e41185 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181538.918110:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.132@tcp lock: ffff9dc180030a00/0x8f4f7840b2e4117e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x8f4f7840b2e41185 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181538.918121:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181538.918123:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181538.918124:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789181538.918135:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c01b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:880710ad-110c-42a4-a174-ab1b99a7ebeb:3306:1876092510097024:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789181538.918165:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181538.918484:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510096896 00000100:00100000:3.0:1789181538.918491:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510096896 00000100:00100000:3.0:1789181538.918540:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1789181538.918549:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0833d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876092510096896:12345-0@lo:39:umount.0 00000020:00000080:3.0:1789181538.918573:0:5844:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8f4f7840b2e40f08 00000100:00080000:3.0:1789181538.918581:0:5844:0:(import.c:65:import_set_state_nolock()) ffff9dc1961a0000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1789181538.919183:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510097024 00000100:00100000:0.0:1789181538.919191:0:8456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510097024 00000100:00100000:0.0:1789181538.919519:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789181538.919528:0:8456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c01b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:880710ad-110c-42a4-a174-ab1b99a7ebeb+19:3306:x1876092510097024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789181538.919540:0:8456:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789181538.919557:0:8456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc1c2045800/0x8f4f7840b2e41185 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8f4f7840b2e4117e expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181538.919572:0:8456:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789181538.919619:0:8456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c01b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:880710ad-110c-42a4-a174-ab1b99a7ebeb+18:3306:x1876092510097024:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (1453us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181538.919626:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789181538.919791:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c01b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:880710ad-110c-42a4-a174-ab1b99a7ebeb:3306:1876092510097024:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789181538.920791:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0833d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3302:x1876092510096896:12345-0@lo:39:umount.0 Request processed in 2239us (2880us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181538.920802:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000020:00000080:3.0:1789181538.920813:0:5844:0:(genops.c:885:class_export_put()) final put ffff9dc1992d0000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:3.0:1789181538.920837:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789181538.920847:0:11922:0:(genops.c:844:class_export_destroy()) destroying export ffff9dc1992d0000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000100:00080000:2.0:1789181538.920885:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9dc187aeb000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000020:00000080:3.0:1789181538.920895:0:11922:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9dc1961a0000 for lustre-MDT0000 00000100:00100000:2.0:1789181538.920912:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6e5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876092510096896:0@lo:39:umount.0 00000100:00080000:0.0:1789181538.920939:0:13028:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789181538.920944:0:13028:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789181538.920949:0:13028:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1789181538.921998:0:13028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc1ba784e00/0x8f4f7840b2e4118c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e41193 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181538.922171:0:13028:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc1ba784e00/0x8f4f7840b2e4118c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f4f7840b2e41193 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181538.922179:0:13028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc1ba784e00/0x8f4f7840b2e4118c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x8f4f7840b2e41193 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181538.922186:0:13028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.132@tcp lock: ffff9dc1ba784e00/0x8f4f7840b2e4118c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x8f4f7840b2e41193 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181538.922254:0:13028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789181538.922260:0:13028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc18151be00/0x8f4f7840b2e410b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e410ba expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181538.922267:0:13028:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc18151be00/0x8f4f7840b2e410b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f4f7840b2e410ba expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181538.922273:0:13028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc18151be00/0x8f4f7840b2e410b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x8f4f7840b2e410ba expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181538.922279:0:13028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.132@tcp lock: ffff9dc18151be00/0x8f4f7840b2e410b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x8f4f7840b2e410ba expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181538.922493:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789181538.922501:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.132@tcp lock: ffff9dc1ba784e00/0x8f4f7840b2e4118c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x8f4f7840b2e41193 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181538.922516:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1ba784e00 already unused, calling callback (ffffffffc1b45c20) 10000000:00010000:3.0:1789181538.922520:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.132@tcp lock: ffff9dc1ba784e00/0x8f4f7840b2e4118c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x8f4f7840b2e41193 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181538.922528:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.132@tcp lock: ffff9dc1ba784e00/0x8f4f7840b2e4118c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x8f4f7840b2e41193 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789181538.922536:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.132@tcp lock: ffff9dc1ba784e00/0x8f4f7840b2e4118c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x8f4f7840b2e41193 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789181538.922542:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789181538.922545:0:5830:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1789181538.922578:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.132@tcp lock: ffff9dc1ba784e00/0x8f4f7840b2e4118c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x8f4f7840b2e41193 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181538.922585:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789181538.922639:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c01b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:880710ad-110c-42a4-a174-ab1b99a7ebeb:3303:1876092510097152:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789181538.922701:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181538.922787:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510097152 00000100:00100000:2.0:1789181538.922794:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510097152 00000100:00100000:2.0:1789181538.922843:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789181538.922852:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6e5c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:880710ad-110c-42a4-a174-ab1b99a7ebeb+18:3303:x1876092510097152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789181538.922864:0:6707:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789181538.922877:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc1c2044600/0x8f4f7840b2e41193 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8f4f7840b2e4118c expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181538.922901:0:6707:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789181538.922952:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.132@tcp lock: ffff9dc1ba784e00/0x8f4f7840b2e4118c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x8f4f7840b2e41193 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181538.922960:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.132@tcp lock: ffff9dc1ba784e00/0x8f4f7840b2e4118c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x8f4f7840b2e41193 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181538.922971:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789181538.922974:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.132@tcp lock: ffff9dc18151be00/0x8f4f7840b2e410b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x8f4f7840b2e410ba expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181538.922980:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc18151be00 already unused, calling callback (ffffffffc1b45c20) 10000000:00010000:3.0:1789181538.922983:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.132@tcp lock: ffff9dc18151be00/0x8f4f7840b2e410b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x8f4f7840b2e410ba expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181538.923002:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.132@tcp lock: ffff9dc18151be00/0x8f4f7840b2e410b3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x8f4f7840b2e410ba expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789181538.923009:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.132@tcp lock: ffff9dc18151be00/0x8f4f7840b2e410b3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x8f4f7840b2e410ba expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789181538.923014:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1789181538.923016:0:5830:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:3.0:1789181538.923041:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.132@tcp lock: ffff9dc18151be00/0x8f4f7840b2e410b3 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x8f4f7840b2e410ba expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181538.923048:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789181538.923248:0:13028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 10000000:01000000:0.0:1789181538.923254:0:13028:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1789181538.923671:0:13028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc1c2045e00/0x8f4f7840b2e413b5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e413bc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181538.923681:0:13028:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc1c2045e00/0x8f4f7840b2e413b5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f4f7840b2e413bc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181538.923701:0:13028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc1c2045e00/0x8f4f7840b2e413b5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x8f4f7840b2e413bc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181538.923707:0:13028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.132@tcp lock: ffff9dc1c2045e00/0x8f4f7840b2e413b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x8f4f7840b2e413bc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181538.923716:0:13028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789181538.923722:0:13028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc1c2044c00/0x8f4f7840b2e40e67 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e40e6e expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181538.923728:0:13028:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc1c2044c00/0x8f4f7840b2e40e67 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f4f7840b2e40e6e expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181538.923735:0:13028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc1c2044c00/0x8f4f7840b2e40e67 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x8f4f7840b2e40e6e expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181538.923741:0:13028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.132@tcp lock: ffff9dc1c2044c00/0x8f4f7840b2e40e67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x8f4f7840b2e40e6e expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181538.923748:0:13028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1789181538.923751:0:13028:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1789181538.923753:0:13028:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1789181538.923784:0:13028:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1789181538.923788:0:13028:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1789181538.923792:0:13028:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789181538.923797:0:13028:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000020:00080000:0.0:1789181538.923804:0:13028:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9dc1ba453000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789181538.923810:0:13028:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9dc1c10a2000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789181538.923826:0:13028:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff9dc1b6718800 7badad21-a177-49b1-a2af-7b11e28c02ce 192.168.204.32@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789181538.923831:0:13028:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff9dc1885199c0) has exports, disconnecting them 00000020:00080000:0.0:1789181538.923836:0:13028:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9dc1ba453000), last request at 1789181536 00000020:00000080:0.0:1789181538.923843:0:13028:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8f4f7840b2e4107b 00000100:00080000:0.0:1789181538.923858:0:13028:0:(import.c:65:import_set_state_nolock()) ffff9dc1ba451800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1789181538.923892:0:13028:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dc1ba453000): rc 0 00000020:00000080:0.0:1789181538.923895:0:13028:0:(genops.c:885:class_export_put()) final put ffff9dc1ba453000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1789181538.923903:0:13028:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9dc1c10a2000), last request at 1789181536 00000020:00000080:0.0:1789181538.923906:0:13028:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8f4f7840b2e40fb0 00000100:00080000:0.0:1789181538.923910:0:13028:0:(import.c:65:import_set_state_nolock()) ffff9dc1c10a7000 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1789181538.923918:0:706:0:(genops.c:844:class_export_destroy()) destroying export ffff9dc1ba453000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1789181538.923956:0:706:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9dc1ba451800 for lustre-MDT0000 00000020:00080000:0.0:1789181538.923966:0:13028:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dc1c10a2000): rc 0 00000020:00000080:0.0:1789181538.923968:0:13028:0:(genops.c:885:class_export_put()) final put ffff9dc1c10a2000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:0.0:1789181538.923976:0:13028:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffaf38c3bbfae0 00000020:00000080:0.0:1789181538.923987:0:706:0:(genops.c:844:class_export_destroy()) destroying export ffff9dc1c10a2000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1789181538.924006:0:706:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9dc1c10a7000 for lustre-MDT0000 00000100:00080000:0.0:1789181538.924040:0:13028:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789181538.924044:0:13028:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:0.0:1789181538.924056:0:13028:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1789181538.924123:0:13028:0:(pinger.c:399:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1789181538.924138:0:13028:0:(import.c:65:import_set_state_nolock()) ffff9dc1878b7000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1789181538.924153:0:13028:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789181538.924156:0:13028:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:0.0:1789181538.924165:0:13028:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1789181538.924222:0:13028:0:(pinger.c:399:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1789181538.924230:0:13028:0:(import.c:65:import_set_state_nolock()) ffff9dc1bfb98800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1789181538.924257:0:13028:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff9dc1885199c0) has no exports 00000100:00100000:2.0:1789181538.924758:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6e5c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:880710ad-110c-42a4-a174-ab1b99a7ebeb+17:3303:x1876092510097152:12345-0@lo:103:ldlm_bl.0 Request processed in 1903us (2053us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181538.924768:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789181538.924843:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c01c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1876092510097408:0@lo:9:umount.0 00000100:00100000:2.0:1789181538.924890:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181538.924912:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c01c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1876092510097536:0@lo:9:umount.0 00000100:00100000:2.0:1789181538.924929:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181538.924954:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510097408 00000100:00100000:2.0:1789181538.924960:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510097408 00000100:00100000:2.0:1789181538.924994:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510097536 00000100:00100000:2.0:1789181538.924996:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510097536 00000100:00100000:2.0:1789181538.925013:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789181538.925020:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0833d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1876092510097408:12345-0@lo:9:umount.0 00000020:00000080:2.0:1789181538.925053:0:6691:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8f4f7840b2e40ffd 00000100:00080000:2.0:1789181538.925058:0:6691:0:(import.c:65:import_set_state_nolock()) ffff9dc081297000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789181538.925089:0:6691:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:2.0:1789181538.925248:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0833d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3302:x1876092510097408:12345-0@lo:9:umount.0 Request processed in 227us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181538.925254:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789181538.925266:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789181538.925272:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0833d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1876092510097536:12345-0@lo:9:umount.0 00000020:00000080:2.0:1789181538.925284:0:6691:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8f4f7840b2e410e4 00000100:00080000:2.0:1789181538.925315:0:6691:0:(import.c:65:import_set_state_nolock()) ffff9dc1b671e000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789181538.925356:0:6691:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:2.0:1789181538.925609:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0833d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3302:x1876092510097536:12345-0@lo:9:umount.0 Request processed in 337us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181538.925615:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:2.0:1789181538.925634:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789181538.925639:0:5838:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789181538.925670:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9dc1878b7000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1789181538.925681:0:3302:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1789181538.925684:0:3302:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789181538.925687:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c01c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1876092510097408:0@lo:9:umount.0 00000100:00080000:2.0:1789181538.925697:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9dc1bfb98800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1789181538.925701:0:3302:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1789181538.925703:0:3302:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789181538.925705:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c01c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1876092510097536:0@lo:9:umount.0 00000100:00100000:1.0:1789181538.926206:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c01b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:880710ad-110c-42a4-a174-ab1b99a7ebeb:3303:1876092510097152:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789181538.926222:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789181538.926231:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1988c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:880710ad-110c-42a4-a174-ab1b99a7ebeb:3303:1876092510097280:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789181538.926264:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181538.926320:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510097280 00000100:00100000:1.0:1789181538.926347:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510097280 00000100:00100000:1.0:1789181538.926485:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789181538.926494:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6e5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:880710ad-110c-42a4-a174-ab1b99a7ebeb+17:3303:x1876092510097280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789181538.926505:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789181538.926521:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc1c2175a00/0x8f4f7840b2e410ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8f4f7840b2e410b3 expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181538.926540:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789181538.926569:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6e5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:880710ad-110c-42a4-a174-ab1b99a7ebeb+16:3303:x1876092510097280:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181538.926590:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789181538.926620:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1988c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:880710ad-110c-42a4-a174-ab1b99a7ebeb:3303:1876092510097280:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789181538.926739:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.132@tcp lock: ffff9dc18151be00/0x8f4f7840b2e410b3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x8f4f7840b2e410ba expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181538.926748:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.132@tcp lock: ffff9dc18151be00/0x8f4f7840b2e410b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x8f4f7840b2e410ba expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181538.926763:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789181538.926768:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.132@tcp lock: ffff9dc1c2045e00/0x8f4f7840b2e413b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x8f4f7840b2e413bc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181538.926774:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1c2045e00 already unused, calling callback (ffffffffc1b45c20) 10000000:00010000:3.0:1789181538.926777:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.132@tcp lock: ffff9dc1c2045e00/0x8f4f7840b2e413b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x8f4f7840b2e413bc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181538.926786:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.132@tcp lock: ffff9dc1c2045e00/0x8f4f7840b2e413b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x8f4f7840b2e413bc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789181538.926793:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.132@tcp lock: ffff9dc1c2045e00/0x8f4f7840b2e413b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x8f4f7840b2e413bc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789181538.926806:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1789181538.926809:0:5830:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1789181538.926812:0:5830:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1789181538.926834:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.132@tcp lock: ffff9dc1c2045e00/0x8f4f7840b2e413b5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x8f4f7840b2e413bc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181538.926842:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789181538.926873:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.132@tcp lock: ffff9dc1c2045e00/0x8f4f7840b2e413b5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x8f4f7840b2e413bc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181538.926881:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.132@tcp lock: ffff9dc1c2045e00/0x8f4f7840b2e413b5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x8f4f7840b2e413bc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181538.926891:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789181538.926894:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.132@tcp lock: ffff9dc1c2044c00/0x8f4f7840b2e40e67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x8f4f7840b2e40e6e expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181538.926900:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1c2044c00 already unused, calling callback (ffffffffc1b45c20) 10000000:00010000:3.0:1789181538.926902:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.132@tcp lock: ffff9dc1c2044c00/0x8f4f7840b2e40e67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x8f4f7840b2e40e6e expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181538.926909:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.132@tcp lock: ffff9dc1c2044c00/0x8f4f7840b2e40e67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x8f4f7840b2e40e6e expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789181538.926915:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.132@tcp lock: ffff9dc1c2044c00/0x8f4f7840b2e40e67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x8f4f7840b2e40e6e expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789181538.926920:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1789181538.926922:0:5830:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1789181538.926924:0:5830:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1789181538.926943:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.132@tcp lock: ffff9dc1c2044c00/0x8f4f7840b2e40e67 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x8f4f7840b2e40e6e expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181538.926950:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789181538.926956:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.132@tcp lock: ffff9dc1c2044c00/0x8f4f7840b2e40e67 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x8f4f7840b2e40e6e expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181538.926962:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.132@tcp lock: ffff9dc1c2044c00/0x8f4f7840b2e40e67 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x8f4f7840b2e40e6e expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181538.926985:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181538.926987:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181538.926989:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789181538.927012:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1988c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:880710ad-110c-42a4-a174-ab1b99a7ebeb:3306:1876092510097792:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789181538.927112:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1988c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:880710ad-110c-42a4-a174-ab1b99a7ebeb:3305:1876092510097664:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789181538.927141:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181538.927203:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789181538.927235:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181538.927270:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510097664 00000100:00100000:0.0:1789181538.927274:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510097664 00000100:00100000:0.0:1789181538.927316:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510097792 00000100:00100000:0.0:1789181538.927319:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510097792 00000100:00100000:0.0:1789181538.927362:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789181538.927473:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c01c5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:880710ad-110c-42a4-a174-ab1b99a7ebeb+17:3305:x1876092510097664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789181538.927484:0:6707:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789181538.927494:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc189890800/0x8f4f7840b2e413bc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8f4f7840b2e413b5 expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181538.927503:0:6707:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789181538.927530:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c01c5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:880710ad-110c-42a4-a174-ab1b99a7ebeb+16:3305:x1876092510097664:12345-0@lo:103:ldlm_bl.0 Request processed in 162us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181538.927535:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789181538.927549:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789181538.927554:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1988c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:880710ad-110c-42a4-a174-ab1b99a7ebeb+15:3306:x1876092510097792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789181538.927560:0:6707:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789181538.927568:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc1c2175c00/0x8f4f7840b2e40e6e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8f4f7840b2e40e67 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181538.927578:0:6707:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789181538.927601:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1988c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:880710ad-110c-42a4-a174-ab1b99a7ebeb+14:3306:x1876092510097792:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181538.927607:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789181538.927632:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1988c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:880710ad-110c-42a4-a174-ab1b99a7ebeb:3305:1876092510097664:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789181538.927757:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1988c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:880710ad-110c-42a4-a174-ab1b99a7ebeb:3306:1876092510097792:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1789181538.933696:0:13028:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff9dc1885199c0) has no exports 00000020:00000080:0.0:1789181538.985013:0:13028:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8f4f7840b2e40ec2 00000020:00000080:0.0:1789181538.985029:0:13028:0:(genops.c:885:class_export_put()) final put ffff9dc1babb6800/lustre-QMT0000_UUID 00000020:01000000:0.0:1789181538.985039:0:13028:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1789181538.985158:0:706:0:(genops.c:844:class_export_destroy()) destroying export ffff9dc1babb6800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1789181538.985229:0:13028:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789181538.985310:0:13028:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789181538.985315:0:13028:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff9dc1c10919c0) has no exports 00000020:00000080:1.0:1789181538.986010:0:13028:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8f4f7840b2e40ebb 00000020:00000080:1.0:1789181538.986017:0:13028:0:(genops.c:885:class_export_put()) final put ffff9dc1a68c6800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789181538.986033:0:10892:0:(genops.c:844:class_export_destroy()) destroying export ffff9dc1a68c6800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789181538.986080:0:13028:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789181538.986087:0:13028:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1789181538.986089:0:13028:0:(genops.c:885:class_export_put()) final put ffff9dc1ba280800/lustre-QMT0000_UUID 00000020:00000080:1.0:1789181538.986091:0:13028:0:(genops.c:844:class_export_destroy()) destroying export ffff9dc1ba280800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1789181538.986095:0:13028:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:3.0:1789181539.902486:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789181539.934788:0:6718:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789181539.934797:0:6718:0:(genops.c:885:class_export_put()) final put ffff9dc081295800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1789181539.934819:0:6718:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5971a429-48ca-4c07-88a3-fa58102a53bc 00000020:00000080:2.0:1789181539.934821:0:6718:0:(genops.c:885:class_export_put()) final put ffff9dc1c0241000/5971a429-48ca-4c07-88a3-fa58102a53bc 00000020:00000080:2.0:1789181539.934838:0:11708:0:(genops.c:844:class_export_destroy()) destroying export ffff9dc081295800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1789181539.934897:0:11708:0:(genops.c:844:class_export_destroy()) destroying export ffff9dc1c0241000/5971a429-48ca-4c07-88a3-fa58102a53bc for lustre-OST0000 00000020:00000080:2.0:1789181539.935141:0:11708:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9dc081297000 for lustre-OST0000 00000020:00000080:2.0:1789181539.935147:0:11708:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9dc1c0240800 for lustre-OST0000 00000001:00100000:1.0:1789181540.442990:0:5865:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7badad21-a177-49b1-a2af-7b11e28c02ce 00000001:00080000:1.0:1789181540.443006:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:1.0:1789181540.443011:0:5865:0:(genops.c:885:class_export_put()) final put ffff9dc1b6718800/7badad21-a177-49b1-a2af-7b11e28c02ce 00000020:00000080:1.0:1789181540.443036:0:10892:0:(genops.c:844:class_export_destroy()) destroying export ffff9dc1b6718800/7badad21-a177-49b1-a2af-7b11e28c02ce for lustre-MDT0000 00000020:00000080:1.0:1789181540.443107:0:10892:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9dc1b6719000 for lustre-MDT0000 00000001:00100000:0.0:1789181540.488087:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789181540.488099:0:7647:0:(genops.c:885:class_export_put()) final put ffff9dc1babb2000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789181540.488135:0:706:0:(genops.c:844:class_export_destroy()) destroying export ffff9dc1babb2000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1789181540.488410:0:706:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9dc1b671e000 for lustre-OST0001 00010000:00010000:3.0:1789181540.926526:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1789181540.991220:0:13028:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9dc1b6b6cae0 - data ffff9dc1bffbfd80/ffff9dc1baae4c00 00000020:01000000:1.0:1789181540.991433:0:13028:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9dc1aa4e7960 - data ffff9dc1ad3a9a20/ffff9dc1c10bc000 00000001:00000004:1.0:1789181541.001697:0:13028:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:2.0:1789181541.035442:0:13028:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789181541.035450:0:13028:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1789181541.035475:0:13028:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789181541.035477:0:13028:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1789181541.037148:0:6884:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1789181541.037154:0:6884:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:1.0:1789181541.037166:0:6884:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1789181541.038188:0:13028:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789181541.038194:0:13028:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:2.0:1789181541.038204:0:13028:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789181541.038206:0:13028:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1789181541.038540:0:8012:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1789181541.038545:0:8012:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:1.0:1789181541.038554:0:8012:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1789181541.107652:0:13028:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8f4f7840b2e40e8a 00000020:00000080:0.0:1789181541.107663:0:13028:0:(genops.c:885:class_export_put()) final put ffff9dc18685e800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789181541.108886:0:13028:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8f4f7840b2e40e9f 00000020:00000080:0.0:1789181541.108894:0:13028:0:(genops.c:885:class_export_put()) final put ffff9dc18685f000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1789181541.108901:0:13028:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1789181541.108906:0:13028:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789181541.108914:0:13028:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789181541.108918:0:13028:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff9dc188518000) has no exports 00000004:01000000:0.0:1789181541.109065:0:13028:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1789181541.109073:0:13028:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8f4f7840b2e410dd 00000020:00000080:0.0:1789181541.109077:0:13028:0:(genops.c:885:class_export_put()) final put ffff9dc1878b7800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1789181541.109081:0:13028:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1789181541.109084:0:13028:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789181541.109090:0:13028:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789181541.109092:0:13028:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff9dc189d14d40) has no exports 00000020:00000080:0.0:1789181541.109099:0:13028:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8f4f7840b2e410d6 00000020:00000080:0.0:1789181541.109101:0:13028:0:(genops.c:885:class_export_put()) final put ffff9dc1bfb9a000/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1789181541.109466:0:13028:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1789181541.109470:0:13028:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789181541.109475:0:13028:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:0.0:1789181541.109481:0:13028:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789181541.109483:0:13028:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789181541.109513:0:13028:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789181541.109520:0:13028:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789181541.109536:0:13028:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8f4f7840b2e40ff6 00000020:00000080:0.0:1789181541.109541:0:13028:0:(genops.c:885:class_export_put()) final put ffff9dc1878b6800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1789181541.109545:0:13028:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1789181541.109548:0:13028:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789181541.109551:0:13028:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789181541.109554:0:13028:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff9dc1c1094d40) has no exports 00000020:00000080:0.0:1789181541.109557:0:13028:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8f4f7840b2e40fef 00000020:00000080:0.0:1789181541.109560:0:13028:0:(genops.c:885:class_export_put()) final put ffff9dc1878b5800/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1789181541.109869:0:13028:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1789181541.109872:0:13028:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789181541.109874:0:13028:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:0.0:1789181541.109878:0:13028:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789181541.109879:0:13028:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789181541.109898:0:13028:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789181541.109902:0:13028:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789181541.109929:0:13028:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789181541.109931:0:13028:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789181541.111379:0:13028:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8f4f7840b2e40ea6 00000020:00000080:0.0:1789181541.111401:0:13028:0:(genops.c:885:class_export_put()) final put ffff9dc18685d800/lustre-MDD0000_UUID 00000020:01000000:0.0:1789181541.111409:0:13028:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1789181541.111414:0:13028:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789181541.111421:0:13028:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789181541.111425:0:13028:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff9dc1babcb380) has no exports 00000020:00000080:0.0:1789181541.111447:0:13028:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789181541.111473:0:13028:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1789181541.111478:0:13028:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8f4f7840b2e40ead 00000020:00000080:0.0:1789181541.111482:0:13028:0:(genops.c:885:class_export_put()) final put ffff9dc18685d000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1789181541.111490:0:13028:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dc1add60800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1789181541.111493:0:13028:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dc1add60800 3 00000020:01000004:0.0:1789181541.111511:0:13028:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9dc1add60800 from lustre-MDT0000 00000020:00000080:0.0:1789181541.111534:0:13028:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789181541.111538:0:13028:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1789181541.111550:0:13028:0:(genops.c:885:class_export_put()) final put ffff9dc18685c800/lustre-MDT0000_UUID 00000020:00000080:0.0:1789181541.111553:0:13028:0:(genops.c:844:class_export_destroy()) destroying export ffff9dc18685c800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1789181541.111565:0:13028:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1789181541.111642:0:13028:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:0.0:1789181541.111646:0:13028:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1789181541.111649:0:13028:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1789181541.111652:0:13028:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789181541.111655:0:13028:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789181541.111661:0:13028:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff9dc188567000 880710ad-110c-42a4-a174-ab1b99a7ebeb 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789181541.111667:0:13028:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff9dc1898b8000) has exports, disconnecting them 00000020:00080000:0.0:1789181541.111671:0:13028:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9dc188567000), last request at 1789181310 00000020:00000080:0.0:1789181541.111684:0:13028:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8f4f7840b2e40e4b 00000020:00010000:0.0:1789181541.111697:0:13028:0:(genops.c:1922:obd_stale_export_put()) Put export ffff9dc188567000: total 8 00000100:00080000:0.0:1789181541.111701:0:13028:0:(import.c:65:import_set_state_nolock()) ffff9dc188564000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1789181541.111715:0:13028:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dc188567000): rc 0 00000020:00080000:0.0:1789181541.111719:0:13028:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff9dc1898b8000) has no exports 00000100:00100000:0.0:1789181541.111777:0:5836:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff9dc188a97600:5836] 1 exiting: rc = 0 00000100:00100000:1.0:1789181541.111832:0:5835:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff9dc1879af400:5835] 0 exiting: rc = 1 00000100:00100000:0.0:1789181541.112068:0:5837:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff9dc189c1f600:5837] 2 exiting: rc = 0 00000020:00000080:0.0:1789181541.112102:0:706:0:(genops.c:844:class_export_destroy()) destroying export ffff9dc18685e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789181541.112140:0:706:0:(genops.c:844:class_export_destroy()) destroying export ffff9dc18685f000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:0.0:1789181541.112144:0:706:0:(genops.c:885:class_export_put()) final put ffff9dc1a68c8000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789181541.112146:0:706:0:(genops.c:844:class_export_destroy()) destroying export ffff9dc1a68c8000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1789181541.112149:0:706:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789181541.112270:0:706:0:(genops.c:844:class_export_destroy()) destroying export ffff9dc1878b7800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1789181541.112276:0:706:0:(genops.c:844:class_export_destroy()) destroying export ffff9dc1bfb9a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789181541.112281:0:706:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9dc1bfb98800 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1789181541.112284:0:706:0:(genops.c:885:class_export_put()) final put ffff9dc1aa5c3800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789181541.112286:0:706:0:(genops.c:844:class_export_destroy()) destroying export ffff9dc1aa5c3800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1789181541.112289:0:706:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789181541.112323:0:706:0:(genops.c:844:class_export_destroy()) destroying export ffff9dc1878b6800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1789181541.112348:0:706:0:(genops.c:844:class_export_destroy()) destroying export ffff9dc1878b5800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789181541.112355:0:706:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9dc1878b7000 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1789181541.112360:0:706:0:(genops.c:885:class_export_put()) final put ffff9dc1ba280000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789181541.112363:0:706:0:(genops.c:844:class_export_destroy()) destroying export ffff9dc1ba280000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1789181541.112368:0:706:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00010000:2.0:1789181541.112385:0:5830:0:(genops.c:1908:obd_stale_export_get()) Get export ffff9dc188567000: total 2 00010000:00010000:2.0:1789181541.112440:0:5830:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9dc188567000, canceled 0 locks, left on hash table 8. 00010000:00010000:2.0:1789181541.112472:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc180030600/0x8f4f7840b2e4115b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8f4f7840b2e41154 expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181541.112503:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc1c2045000/0x8f4f7840b2e41169 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8f4f7840b2e41162 expref: 8 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181541.112515:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc1bfa1f200/0x8f4f7840b2e41177 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8f4f7840b2e41170 expref: 7 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181541.112528:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc1c2044800/0x8f4f7840b2e413a0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8f4f7840b2e41399 expref: 6 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181541.112555:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc1bfa1e400/0x8f4f7840b2e413ae lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8f4f7840b2e413a7 expref: 5 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1789181541.112561:0:706:0:(genops.c:844:class_export_destroy()) destroying export ffff9dc18685d800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1789181541.112568:0:706:0:(genops.c:885:class_export_put()) final put ffff9dc18685e000/lustre-MDD0000_UUID 00000020:00000080:0.0:1789181541.112571:0:706:0:(genops.c:844:class_export_destroy()) destroying export ffff9dc18685e000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1789181541.112576:0:706:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00010000:00010000:2.0:1789181541.112577:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc1c2044200/0x8f4f7840b2e40f63 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8f4f7840b2e40f5c expref: 4 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1789181541.112854:0:706:0:(genops.c:844:class_export_destroy()) destroying export ffff9dc18685d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:1.0:1789181541.112876:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181541.112885:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181541.112891:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181541.112896:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181541.112901:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181541.112906:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181541.112912:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181541.112917:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181541.112923:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181541.112929:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181541.112934:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181541.112939:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181541.112944:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181541.112950:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181541.112955:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181541.112960:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181541.112966:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181541.112972:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181541.112978:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181541.112983:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181541.112988:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181541.112993:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181541.113000:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181541.113008:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181541.113015:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181541.113023:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181541.113037:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181541.113045:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181541.113052:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181541.113059:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181541.113068:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181541.113075:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181541.113082:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181541.113090:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181541.113097:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181541.113116:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181541.113124:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181541.113133:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181541.113146:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181541.113156:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181541.113162:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181541.113167:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181541.113178:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181541.113611:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181541.113618:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181541.113624:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181541.113629:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181541.113635:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:2.0:1789181541.113770:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc180030c00/0x8f4f7840b2e411a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8f4f7840b2e4119a expref: 3 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181541.113796:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc1bfa1e000/0x8f4f7840b2e4114d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8f4f7840b2e41146 expref: 2 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181541.113810:0:5830:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9dc188567000, canceled 8 locks, left on hash table 0. 00000020:00000080:2.0:1789181541.113834:0:5830:0:(genops.c:885:class_export_put()) final put ffff9dc188567000/880710ad-110c-42a4-a174-ab1b99a7ebeb 00010000:00010000:2.0:1789181541.113847:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181541.113849:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181541.113852:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789181541.113863:0:11708:0:(genops.c:844:class_export_destroy()) destroying export ffff9dc188567000/880710ad-110c-42a4-a174-ab1b99a7ebeb for MGS 00000020:00000080:2.0:1789181541.113899:0:11708:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9dc188564000 for MGS 00000100:00100000:1.0:1789181541.114009:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181541.114014:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181541.114019:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181541.114047:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181541.114053:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181541.114058:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181541.114188:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181541.114196:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181541.114205:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181541.114213:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181541.114220:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181541.114228:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181541.114237:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181541.114257:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181541.114268:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181541.114274:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:1.0:1789181541.115085:0:13028:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789181541.115089:0:13028:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:1.0:1789181541.116019:0:13028:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9dc1bfa9c8a0 - data ffff9dc1ad3b3000/ffff9dc1ba7b2400 00000020:01000000:1.0:1789181541.116229:0:13028:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9dc187949ba0 - data ffff9dc18218a798/ffff9dc189888000 00000020:00000080:1.0:1789181541.117182:0:13028:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8f4f7840b2e40e2f 00000020:00000080:1.0:1789181541.117191:0:13028:0:(genops.c:885:class_export_put()) final put ffff9dc1add66000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789181541.117214:0:10892:0:(genops.c:844:class_export_destroy()) destroying export ffff9dc1add66000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:1.0:1789181541.117225:0:13028:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dc1add60800 from MGS, refs=2 00000020:01000004:1.0:1789181541.117229:0:13028:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dc1add60800 2 00000020:01000004:1.0:1789181541.117232:0:13028:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9dc1add60800 from MGS 00000020:00000080:1.0:1789181541.117488:0:13028:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789181541.117496:0:13028:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1789181541.117499:0:13028:0:(genops.c:885:class_export_put()) final put ffff9dc189dfa000/MGS 00000020:00000080:1.0:1789181541.117501:0:13028:0:(genops.c:844:class_export_destroy()) destroying export ffff9dc189dfa000/MGS for MGS 00000020:01000000:1.0:1789181541.117507:0:13028:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1789181541.117563:0:13028:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1789181541.117567:0:13028:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789181541.117572:0:13028:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789181541.117579:0:13028:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9dc1ba2a3000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789181541.117585:0:13028:0:(genops.c:1552:class_disconnect_exports()) OBD device 8 (ffff9dc1898b99c0) has exports, disconnecting them 00000020:00080000:1.0:1789181541.117590:0:13028:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9dc1ba2a3000), last request at 1789181312 00000020:00000080:1.0:1789181541.117595:0:13028:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8f4f7840b2e40efa 00000020:00080000:1.0:1789181541.117603:0:13028:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dc1ba2a3000): rc 0 00000020:00000080:1.0:1789181541.117607:0:13028:0:(genops.c:885:class_export_put()) final put ffff9dc1ba2a3000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1789181541.117626:0:10892:0:(genops.c:844:class_export_destroy()) destroying export ffff9dc1ba2a3000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1789181541.119385:0:13028:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1789181541.119393:0:13028:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789181541.119397:0:13028:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789181541.119404:0:13028:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789181541.119424:0:706:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9dc187aeb000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1789181541.119568:0:13028:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789181541.119574:0:13028:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1789181541.119577:0:13028:0:(genops.c:885:class_export_put()) final put ffff9dc1babb5000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1789181541.119580:0:13028:0:(genops.c:844:class_export_destroy()) destroying export ffff9dc1babb5000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1789181541.119585:0:13028:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1789181541.119631:0:13028:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dc1add60800 1 00000020:00000080:0.0:1789181541.119634:0:13028:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8f4f7840b2e40e21 00000020:00000080:0.0:1789181541.119650:0:13028:0:(genops.c:885:class_export_put()) final put ffff9dc189dfc000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1789181541.119657:0:13028:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1789181541.119664:0:706:0:(genops.c:844:class_export_destroy()) destroying export ffff9dc189dfc000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789181541.119672:0:13028:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789181541.119676:0:13028:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789181541.119687:0:13028:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff9dc1879d19c0) has no exports 00000020:00000080:3.0:1789181541.162957:0:13028:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789181541.162970:0:13028:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1789181541.162974:0:13028:0:(genops.c:885:class_export_put()) final put ffff9dc1add62800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789181541.162978:0:13028:0:(genops.c:844:class_export_destroy()) destroying export ffff9dc1add62800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1789181541.162984:0:13028:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1789181541.163183:0:13028:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9dc1add67000 00000020:01000000:3.0:1789181541.163205:0:13028:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1789181541.163208:0:13028:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789181541.163212:0:13028:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789181541.163216:0:13028:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff9dc18851b380) has no exports 00000100:00100000:2.0:1789181541.163323:0:6887:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff9dc1960cda00:6887] 3 exiting: rc = 0 00000100:00100000:3.0:1789181541.163355:0:5844:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff9dc186883600:5844] 2 exiting: rc = 0 00000100:00100000:0.0:1789181541.163611:0:5843:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff9dc1aa531a00:5843] 1 exiting: rc = 0 00000100:00100000:0.0:1789181541.164446:0:5842:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff9dc1aa531800:5842] 0 exiting: rc = 1 00000100:00100000:3.0:1789181541.164707:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.164728:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.164735:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.164743:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.164752:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.164760:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.164769:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.164789:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.164798:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.164806:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.164813:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.164820:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.164828:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.164835:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.164841:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.164847:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.164853:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.164859:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.164868:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.164876:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.164883:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.164890:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.164897:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.164905:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.164912:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.164919:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.164927:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.164935:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.164942:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.164950:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.164957:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.164964:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.164972:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.164979:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.164987:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.164995:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.165011:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.165018:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.165025:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.165033:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.165041:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.165048:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.165055:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.165064:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.165071:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.165079:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.165087:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.165094:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.165102:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.165110:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.165118:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.165126:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.165133:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.165141:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.165149:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.165157:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.165163:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.165170:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.165176:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.165183:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.165191:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.165198:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.165205:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.165226:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789181541.172797:0:5846:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9dc186883800:5846] 1 exiting: rc = 0 00000100:00100000:0.0:1789181541.172804:0:5845:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9dc186882e00:5845] 0 exiting: rc = 1 00000100:00100000:3.0:1789181541.172945:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.172954:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.172960:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.172966:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.172973:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.172979:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.172986:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.173005:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.173011:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.173017:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.173024:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.173030:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.173036:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.173041:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.173047:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.173052:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.173058:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.173063:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.173069:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.173074:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.173080:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.173084:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.173090:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.173095:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.173101:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.173107:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.173112:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.173117:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.173123:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.173127:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.173133:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.173139:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.173144:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.173149:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.173154:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.173160:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.173165:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.173170:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.173176:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.173182:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.173187:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.173192:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.173204:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.173209:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.173214:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.173219:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.173224:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.173229:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.173234:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.173239:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.173244:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.173262:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.173267:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.173272:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.173278:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.173284:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.173289:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.173294:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.173300:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.173304:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.173309:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.173314:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.173319:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.173325:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181541.173915:0:5848:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff9dc186883200:5848] 1 exiting: rc = 0 00000100:00100000:2.0:1789181541.174200:0:5847:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff9dc1960e4c00:5847] 0 exiting: rc = 1 00000100:00100000:3.0:1789181541.174239:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.174262:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.174270:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.174276:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.174282:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.174288:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.174293:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.174298:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.174303:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.174322:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.174946:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.174957:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.174962:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.174980:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.174985:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.174991:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.174996:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.175001:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.175007:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.175012:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.175017:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.175038:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.175046:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.175054:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.175060:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.175067:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.175075:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.175082:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.175089:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.175094:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.175100:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.175106:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.175112:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.175133:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.175139:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.175146:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.175151:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.175157:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.175164:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.175170:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.175177:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.175182:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.175188:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.175194:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.175200:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.175223:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.175231:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.175237:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.175261:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.175268:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.175274:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.175280:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.175286:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.175292:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.175298:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.175303:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.175309:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.175328:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.177624:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.177645:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.177653:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.177659:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.177665:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.177671:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789181541.183735:0:5850:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9dc186882200:5850] 1 exiting: rc = 0 00000100:00100000:0.0:1789181541.184365:0:5849:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9dc189d6d800:5849] 0 exiting: rc = 1 00000100:00100000:3.0:1789181541.184444:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.184450:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.184454:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.184458:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.184462:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.184467:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.184471:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.184474:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.184479:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.184482:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.184486:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.184488:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.184491:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.184494:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.184497:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.184499:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.184502:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.184505:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.184508:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.184525:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.184528:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.184531:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.184534:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.184538:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.184541:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.184543:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.184546:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.184549:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.184552:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.184555:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.184567:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.184570:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.184573:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.184577:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.184586:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.184590:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.184593:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.184596:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.184600:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.184603:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.184606:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.184609:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.184612:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.184615:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.184618:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.184621:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.184624:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.184626:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.184629:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.184632:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.184634:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.184637:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.184643:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.184645:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.184653:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.184656:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.184659:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.184662:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.184665:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.184668:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.184670:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.184673:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.184676:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.184679:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789181541.185209:0:5852:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9dc1960e6000:5852] 1 exiting: rc = 0 00000100:00100000:0.0:1789181541.185482:0:5851:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9dc189d54a00:5851] 0 exiting: rc = 1 00000100:00100000:3.0:1789181541.185557:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.185564:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.185569:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.185574:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.185584:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.185590:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.185596:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.185601:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.185606:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.185612:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.185618:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.185624:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.185628:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.185633:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.185639:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.185643:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.185648:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.185653:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.185659:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.185664:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.185668:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.185673:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.185678:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.185683:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.185688:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.185703:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.185709:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.185714:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.185719:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.185723:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.185729:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.185734:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.185739:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.185743:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.185748:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.185753:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.185760:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.185765:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.185771:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.185775:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.185780:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.185785:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.185790:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.185796:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.185801:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.185806:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.185811:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.185816:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.185822:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.185827:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.185832:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.185837:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.185843:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.185848:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.185854:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.185859:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.185865:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.185874:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.185881:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.185887:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.185899:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.185904:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.185910:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.185915:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789181541.186418:0:5854:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff9dc1960e7600:5854] 1 exiting: rc = 0 00000100:00100000:0.0:1789181541.186549:0:5853:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff9dc18855c600:5853] 0 exiting: rc = 1 00000100:00100000:3.0:1789181541.187325:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.187651:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.187681:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.187687:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.187692:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.187697:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.187707:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.187712:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.187716:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.187721:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.187726:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.187731:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.187735:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.187739:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.187744:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.187748:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.187753:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.187758:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.187762:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.187767:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.187772:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.187776:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.187781:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.187785:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.187789:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.187794:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.187798:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.187802:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.187806:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.187810:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.187814:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.187832:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.187836:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.187841:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.187845:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.187849:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.187854:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.187858:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.187862:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.187867:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.187871:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.187876:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.187881:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.187886:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.187890:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.187895:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.187900:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.187906:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.187911:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.187916:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.187921:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.187926:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.187930:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.187935:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.187940:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.187945:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.187950:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.187955:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.187959:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.187964:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.187968:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.187972:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.187976:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.187980:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181541.189707:0:5856:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff9dc189d55e00:5856] 1 exiting: rc = 0 00000100:00100000:1.0:1789181541.190426:0:5857:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff9dc189d54e00:5857] 2 exiting: rc = 0 00000100:00100000:2.0:1789181541.191017:0:5855:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff9dc189d55200:5855] 0 exiting: rc = 1 00000100:00100000:3.0:1789181541.193221:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.193231:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.193272:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.193277:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.193283:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.193290:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.193297:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.193302:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.193307:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.193313:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.193319:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.193325:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.193542:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.193573:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.193581:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.193586:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.193591:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.193596:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.193602:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.193607:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.193615:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.193624:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.193630:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.193704:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.193710:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.193716:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.193723:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.193729:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.193734:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.193740:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.193746:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.193752:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.193757:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.193763:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.193769:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.193775:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.193780:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.193810:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.193817:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.193823:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.193828:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.193834:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.193840:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.193846:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.193852:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.193857:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.193863:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.193867:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.193873:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.193879:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.193884:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.193890:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.193894:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.193900:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.193905:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.193911:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.193916:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.193922:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.193927:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.193933:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.193940:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.193945:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.193950:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181541.193956:0:13028:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1789181541.197928:0:13028:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789181541.197942:0:13028:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1789181541.197948:0:13028:0:(genops.c:885:class_export_put()) final put ffff9dc187aee000/MDS_uuid 00000020:00000080:3.0:1789181541.197953:0:13028:0:(genops.c:844:class_export_destroy()) destroying export ffff9dc187aee000/MDS_uuid for MDS 00000020:01000000:3.0:1789181541.197962:0:13028:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1789181541.198113:0:13028:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:1.0:1789181541.375669:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0833d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:880710ad-110c-42a4-a174-ab1b99a7ebeb:3303:1876092510097920:0@lo:400:kworker.0 00000400:00000100:1.0:1789181541.375723:0:3303:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876092510097920 offset 0 length 224: 4 00000100:00100000:3.0:1789181541.375849:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0833d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1876092510098048:0@lo:400:kworker.0 00000400:00000100:3.0:1789181541.375876:0:3304:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876092510098048 offset 0 length 224: 4 00000100:00100000:0.0:1789181541.376110:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0833d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1876092510098176:0@lo:400:kworker.0 00000400:00000100:0.0:1789181541.376134:0:3305:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876092510098176 offset 0 length 224: 4 00010000:00010000:0.0:1789181541.959121:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181542.976084:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789181543.354683:0:13180:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1789181543.376650:0:13180:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1789181543.376697:0:13180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc180031e00/0x8f4f7840b2e41162 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e41169 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181543.376711:0:13180:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc180031e00/0x8f4f7840b2e41162 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f4f7840b2e41169 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181543.376718:0:13180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc180031e00/0x8f4f7840b2e41162 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x8f4f7840b2e41169 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181543.376725:0:13180:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.132@tcp lock: ffff9dc180031e00/0x8f4f7840b2e41162 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x8f4f7840b2e41169 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181543.376781:0:13180:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789181543.376786:0:13180:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1789181543.376809:0:13180:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789181543.376821:0:13180:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dc0833d2680 x1876092510098048/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181557 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181543.376853:0:13180:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789181543.376859:0:13180:0:(pinger.c:399:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789181543.376883:0:13180:0:(import.c:65:import_set_state_nolock()) ffff9dc081294800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1789181543.378150:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1988c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3302:1876092510098304:0@lo:39:umount.0 00000400:00000100:2.0:1789181543.378219:0:3302:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876092510098304 offset 0 length 224: 4 00000100:00100000:1.0:1789181543.378409:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc0833d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1876092510098048:0@lo:400:kworker.0 00010000:00010000:0.0:1789181543.380162:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789181543.380177:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.132@tcp lock: ffff9dc180031e00/0x8f4f7840b2e41162 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x8f4f7840b2e41169 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181543.380188:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc180031e00 already unused, calling callback (ffffffffc1b45c20) 10000000:00010000:0.0:1789181543.380192:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.132@tcp lock: ffff9dc180031e00/0x8f4f7840b2e41162 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x8f4f7840b2e41169 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181543.380202:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.132@tcp lock: ffff9dc180031e00/0x8f4f7840b2e41162 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x8f4f7840b2e41169 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789181543.380220:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.132@tcp lock: ffff9dc180031e00/0x8f4f7840b2e41162 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x8f4f7840b2e41169 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789181543.380226:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789181543.380228:0:5831:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789181543.380526:0:5831:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1789181543.380640:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.132@tcp lock: ffff9dc180031e00/0x8f4f7840b2e41162 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x8f4f7840b2e41169 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181543.380648:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789181543.380678:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.132@tcp lock: ffff9dc180031e00/0x8f4f7840b2e41162 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x8f4f7840b2e41169 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181543.380691:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.132@tcp lock: ffff9dc180031e00/0x8f4f7840b2e41162 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x8f4f7840b2e41169 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181543.380704:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181543.380706:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181543.380707:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789181543.380752:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6e5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:880710ad-110c-42a4-a174-ab1b99a7ebeb:3306:1876092510098432:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789181543.380825:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181543.381006:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510098432 00000100:00100000:1.0:1789181543.381013:0:8456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510098432 00000100:00100000:1.0:1789181543.381058:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789181543.381065:0:8456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1988c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3306:x1876092510098432:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1789181543.381071:0:8456:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789181543 with bad export cookie 10326604689858367051 00000100:00100000:1.0:1789181543.394017:0:8456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1988c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3306:x1876092510098432:12345-0@lo:103:ldlm_bl.0 Request processed in 12943us (13183us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789181543.394031:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1789181543.395511:0:3306:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.132@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789181543.395518:0:3306:0:(import.c:65:import_set_state_nolock()) ffff9dc187ae8000 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1789181543.395522:0:3306:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.132@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:0.0:1789181543.403700:0:3306:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.132@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1789181543.403706:0:3306:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1789181543.403716:0:3306:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dc0833d1500 x1876092510097920/t0(0) o400->MGC192.168.204.132@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1789181557 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181543.403785:0:3306:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dc1b6e5c000 x1876092510098432/t0(0) o103->MGC192.168.204.132@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789181559 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1789181543.403796:0:3306:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1789181543.403799:0:3306:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1789181543.403800:0:3306:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1789181543.403804:0:3306:0:(import.c:65:import_set_state_nolock()) ffff9dc187ae8000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789181543.403809:0:3306:0:(import.c:545:import_select_connection()) MGC192.168.204.132@tcp: connect to NID 0@lo last attempt 202 00000100:00080000:0.0:1789181543.403824:0:3306:0:(import.c:666:import_select_connection()) MGC192.168.204.132@tcp: import ffff9dc187ae8000 using connection 192.168.204.132@tcp/0@lo 00000100:00100000:0.0:1789181543.404591:0:3306:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc1c01c5180 x1876092510098560/t0(0) o250->MGC192.168.204.132@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789181543.404625:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6e5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:880710ad-110c-42a4-a174-ab1b99a7ebeb:3306:1876092510098432:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789181543.404712:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c01c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:880710ad-110c-42a4-a174-ab1b99a7ebeb:3302:1876092510098560:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:2.0:1789181543.404758:0:3302:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876092510098560 offset 0 length 520: 4 00000100:00100000:1.0:1789181543.407117:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc0833d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:880710ad-110c-42a4-a174-ab1b99a7ebeb:3303:1876092510097920:0@lo:400:kworker.0 00010000:00010000:0.0:1789181543.998738:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181545.025543:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181546.049442:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789181546.494436:0:11708:0:(pinger.c:229:ptlrpc_pinger_process_import()) 880710ad-110c-42a4-a174-ab1b99a7ebeb->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789181546.494445:0:11708:0:(pinger.c:247:ptlrpc_pinger_process_import()) 880710ad-110c-42a4-a174-ab1b99a7ebeb->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789181546.495466:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789181546.495489:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0833d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1876092510098688:0@lo:400:kworker.0 00000400:00000100:0.0:1789181546.495540:0:3304:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876092510098688 offset 0 length 224: 4 00010000:00010000:1.0:1789181547.070898:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181548.094863:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789181548.543272:0:11708:0:(pinger.c:229:ptlrpc_pinger_process_import()) 880710ad-110c-42a4-a174-ab1b99a7ebeb->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789181548.543287:0:11708:0:(pinger.c:247:ptlrpc_pinger_process_import()) 880710ad-110c-42a4-a174-ab1b99a7ebeb->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789181548.543508:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0833d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1876092510098816:0@lo:400:kworker.0 00000400:00000100:0.0:1789181548.543579:0:3304:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876092510098816 offset 0 length 224: 4 00010000:00010000:1.0:1789181549.125887:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181550.145456:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181551.167316:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181552.190667:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181553.215031:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789181553.664375:0:11708:0:(pinger.c:229:ptlrpc_pinger_process_import()) 880710ad-110c-42a4-a174-ab1b99a7ebeb->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789181553.664389:0:11708:0:(pinger.c:247:ptlrpc_pinger_process_import()) 880710ad-110c-42a4-a174-ab1b99a7ebeb->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789181553.664711:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0833d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1876092510098944:0@lo:400:kworker.0 00000400:00000100:3.0:1789181553.664787:0:3305:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876092510098944 offset 0 length 224: 4 00000100:00100000:0.0:1789181553.665218:0:3302:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789181543/real 1789181543] req@ffff9dc1c01c5180 x1876092510098560/t0(0) o250->MGC192.168.204.132@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789181553 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181553.665260:0:3302:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9dc1c01c5180 x1876092510098560/t0(0) o250->MGC192.168.204.132@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789181553 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181553.665272:0:3302:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789181543/real 1789181543] req@ffff9dc1988c2300 x1876092510098304/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789181553 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181553.665290:0:3302:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9dc1988c2300 x1876092510098304/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789181553 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789181553.665304:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9dc187ae8000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789181553.665320:0:3302:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1789181553.665324:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c01c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:880710ad-110c-42a4-a174-ab1b99a7ebeb:3302:1876092510098560:0@lo:250:ptlrpcd_00_03.0 00000100:00080000:0.0:1789181553.665367:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9dc081294800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1789181553.665383:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1988c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3302:1876092510098304:0@lo:39:umount.0 00000100:00080000:0.0:1789181553.665418:0:706:0:(pinger.c:229:ptlrpc_pinger_process_import()) 880710ad-110c-42a4-a174-ab1b99a7ebeb->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789181553.665423:0:706:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1789181553.665426:0:706:0:(import.c:65:import_set_state_nolock()) ffff9dc187ae8000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789181553.665433:0:706:0:(import.c:545:import_select_connection()) MGC192.168.204.132@tcp: connect to NID 0@lo last attempt 435 00000100:00080000:0.0:1789181553.665440:0:706:0:(import.c:630:import_select_connection()) MGC192.168.204.132@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789181553.665452:0:706:0:(import.c:666:import_select_connection()) MGC192.168.204.132@tcp: import ffff9dc187ae8000 using connection 192.168.204.132@tcp/0@lo 00000100:00100000:0.0:1789181553.665478:0:706:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc1c01c5180 x1876092510099072/t0(0) o250->MGC192.168.204.132@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789181553.665509:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c01c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:880710ad-110c-42a4-a174-ab1b99a7ebeb:3302:1876092510099072:0@lo:250:kworker.0 00000400:00000100:0.0:1789181553.665564:0:3302:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876092510099072 offset 0 length 520: 4 00000100:00080000:3.0:1789181553.665807:0:13180:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789181553.665813:0:13180:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789181553.665828:0:13180:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1789181553.669375:0:13180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc1ba784400/0x8f4f7840b2e41170 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e41177 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181553.669395:0:13180:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc1ba784400/0x8f4f7840b2e41170 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f4f7840b2e41177 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181553.669402:0:13180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc1ba784400/0x8f4f7840b2e41170 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x8f4f7840b2e41177 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181553.670899:0:13180:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.132@tcp lock: ffff9dc1ba784400/0x8f4f7840b2e41170 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x8f4f7840b2e41177 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181553.670941:0:13180:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789181553.670951:0:13180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc189891e00/0x8f4f7840b2e413a7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e413ae expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181553.670959:0:13180:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc189891e00/0x8f4f7840b2e413a7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f4f7840b2e413ae expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181553.670965:0:13180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc189891e00/0x8f4f7840b2e413a7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x8f4f7840b2e413ae expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181553.670970:0:13180:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.132@tcp lock: ffff9dc189891e00/0x8f4f7840b2e413a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x8f4f7840b2e413ae expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181553.671000:0:13180:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1789181553.671004:0:13180:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1789181553.671043:0:13180:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1789181553.671048:0:13180:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1789181553.671053:0:13180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789181553.671072:0:13180:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789181553.671077:0:13180:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff9dc1babc99c0) has no exports 00000020:00080000:3.0:1789181553.671101:0:13180:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff9dc1babc99c0) has no exports 00010000:00010000:1.0:1789181553.672647:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789181553.672658:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.132@tcp lock: ffff9dc1ba784400/0x8f4f7840b2e41170 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x8f4f7840b2e41177 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181553.672669:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1ba784400 already unused, calling callback (ffffffffc1b45c20) 10000000:00010000:1.0:1789181553.672673:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.132@tcp lock: ffff9dc1ba784400/0x8f4f7840b2e41170 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x8f4f7840b2e41177 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181553.672702:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.132@tcp lock: ffff9dc1ba784400/0x8f4f7840b2e41170 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x8f4f7840b2e41177 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789181553.672710:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.132@tcp lock: ffff9dc1ba784400/0x8f4f7840b2e41170 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x8f4f7840b2e41177 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789181553.672715:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789181553.672718:0:5831:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1789181553.672721:0:5831:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1789181553.672736:0:5831:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9dc187ae8000 00010000:00010000:1.0:1789181553.672740:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.132@tcp lock: ffff9dc1ba784400/0x8f4f7840b2e41170 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x8f4f7840b2e41177 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181553.672747:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.132@tcp lock: ffff9dc1ba784400/0x8f4f7840b2e41170 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x8f4f7840b2e41177 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181553.672761:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789181553.672765:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.132@tcp lock: ffff9dc189891e00/0x8f4f7840b2e413a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x8f4f7840b2e413ae expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181553.672771:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc189891e00 already unused, calling callback (ffffffffc1b45c20) 10000000:00010000:1.0:1789181553.672774:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.132@tcp lock: ffff9dc189891e00/0x8f4f7840b2e413a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x8f4f7840b2e413ae expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181553.672781:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.132@tcp lock: ffff9dc189891e00/0x8f4f7840b2e413a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x8f4f7840b2e413ae expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789181553.672786:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.132@tcp lock: ffff9dc189891e00/0x8f4f7840b2e413a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x8f4f7840b2e413ae expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789181553.672800:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1789181553.672802:0:5831:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1789181553.672804:0:5831:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1789181553.672810:0:5831:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9dc187ae8000 00010000:00010000:1.0:1789181553.672813:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.132@tcp lock: ffff9dc189891e00/0x8f4f7840b2e413a7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x8f4f7840b2e413ae expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181553.672820:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.132@tcp lock: ffff9dc189891e00/0x8f4f7840b2e413a7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x8f4f7840b2e413ae expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181553.672829:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181553.672830:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181553.672832:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181553.673597:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1789181553.674076:0:13180:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9dc189867360 - data ffff9dc1a3ad7a20/ffff9dc1ba436800 00000020:01000000:3.0:1789181553.674224:0:13180:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9dc1ba6f4a80 - data ffff9dc1ad0ee288/ffff9dc081806400 00100000:10000000:3.0:1789181553.686469:0:13180:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1789181553.720226:0:13180:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8f4f7840b2e40f7f 00000020:00000080:0.0:1789181553.720236:0:13180:0:(genops.c:885:class_export_put()) final put ffff9dc1bfc3c800/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1789181553.720252:0:706:0:(genops.c:844:class_export_destroy()) destroying export ffff9dc1bfc3c800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000004:0.0:1789181553.720262:0:13180:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dc189d1d800 from lustre-OST0000, refs=2 00000020:01000004:0.0:1789181553.720266:0:13180:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dc189d1d800 2 00000020:01000004:0.0:1789181553.720269:0:13180:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9dc189d1d800 from lustre-OST0000 00000020:00000080:0.0:1789181553.720296:0:13180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789181553.720306:0:13180:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1789181553.720309:0:13180:0:(genops.c:885:class_export_put()) final put ffff9dc1c1dc6000/lustre-OST0000_UUID 00000020:00000080:0.0:1789181553.720311:0:13180:0:(genops.c:844:class_export_destroy()) destroying export ffff9dc1c1dc6000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1789181553.720317:0:13180:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1789181553.720436:0:13180:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1789181553.720441:0:13180:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1789181553.720445:0:13180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789181553.720451:0:13180:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789181553.720459:0:13180:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9dc1bfc3b000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789181553.720465:0:13180:0:(genops.c:1552:class_disconnect_exports()) OBD device 12 (ffff9dc1898bb380) has exports, disconnecting them 00000020:00080000:0.0:1789181553.720471:0:13180:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9dc1bfc3b000), last request at 1789181330 00000020:00000080:0.0:1789181553.720475:0:13180:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8f4f7840b2e40fa9 00000020:00080000:0.0:1789181553.720485:0:13180:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dc1bfc3b000): rc 0 00000020:00000080:0.0:1789181553.720490:0:13180:0:(genops.c:885:class_export_put()) final put ffff9dc1bfc3b000/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1789181553.720509:0:706:0:(genops.c:844:class_export_destroy()) destroying export ffff9dc1bfc3b000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1789181553.723541:0:13180:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1789181553.723549:0:13180:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789181553.723554:0:13180:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789181553.723561:0:13180:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789181553.724099:0:10892:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9dc081294800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1789181553.725307:0:13180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789181553.725317:0:13180:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1789181553.725322:0:13180:0:(genops.c:885:class_export_put()) final put ffff9dc081295000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1789181553.725326:0:13180:0:(genops.c:844:class_export_destroy()) destroying export ffff9dc081295000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1789181553.726449:0:13180:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:1.0:1789181553.726507:0:13180:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dc189d1d800 1 00000020:00000080:1.0:1789181553.726513:0:13180:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8f4f7840b2e40f39 00000020:00000080:1.0:1789181553.726520:0:13180:0:(genops.c:885:class_export_put()) final put ffff9dc1b66e3000/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1789181553.726530:0:13180:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1789181553.726542:0:10892:0:(genops.c:844:class_export_destroy()) destroying export ffff9dc1b66e3000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1789181553.726554:0:13180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789181553.727649:0:13180:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789181553.727656:0:13180:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff9dc1babc8000) has no exports 00000020:00000080:3.0:1789181553.760870:0:13180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789181553.760885:0:13180:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1789181553.760890:0:13180:0:(genops.c:885:class_export_put()) final put ffff9dc189d1f000/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1789181553.760894:0:13180:0:(genops.c:844:class_export_destroy()) destroying export ffff9dc189d1f000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1789181553.760903:0:13180:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1789181553.761062:0:13180:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9dc189d1d000 00000020:02000400:3.0:1789181553.761160:0:13180:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1789181554.240465:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181555.262529:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181556.286747:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789181556.813676:0:13332:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1789181556.837579:0:13332:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1789181556.837650:0:13332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc180031400/0x8f4f7840b2e41146 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e4114d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181556.837668:0:13332:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc180031400/0x8f4f7840b2e41146 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f4f7840b2e4114d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181556.837675:0:13332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc180031400/0x8f4f7840b2e41146 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x8f4f7840b2e4114d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181556.837683:0:13332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.132@tcp lock: ffff9dc180031400/0x8f4f7840b2e41146 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x8f4f7840b2e4114d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181556.837706:0:13332:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789181556.837711:0:13332:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1789181556.837735:0:13332:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789181556.837748:0:13332:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dc0833d2a00 x1876092510098176/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181557 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181556.837767:0:13332:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dc0833d2300 x1876092510098688/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181562 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181556.837837:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc0833d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1876092510098176:0@lo:400:kworker.0 00010000:00010000:1.0:1789181556.837890:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789181556.837897:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.132@tcp lock: ffff9dc180031400/0x8f4f7840b2e41146 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x8f4f7840b2e4114d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181556.837905:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc180031400 already unused, calling callback (ffffffffc1b45c20) 10000000:00010000:1.0:1789181556.837909:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.132@tcp lock: ffff9dc180031400/0x8f4f7840b2e41146 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x8f4f7840b2e4114d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181556.837918:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.132@tcp lock: ffff9dc180031400/0x8f4f7840b2e41146 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x8f4f7840b2e4114d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789181556.837926:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.132@tcp lock: ffff9dc180031400/0x8f4f7840b2e41146 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x8f4f7840b2e4114d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789181556.837932:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789181556.837934:0:5830:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1789181556.837937:0:5830:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1789181556.837960:0:5830:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9dc187ae8000 00010000:00010000:1.0:1789181556.837965:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.132@tcp lock: ffff9dc180031400/0x8f4f7840b2e41146 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x8f4f7840b2e4114d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181556.837971:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.132@tcp lock: ffff9dc180031400/0x8f4f7840b2e41146 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x8f4f7840b2e4114d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181556.837983:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181556.837985:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181556.837987:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181556.839175:0:13332:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dc0833d0a80 x1876092510098816/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181564 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181556.839187:0:13332:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dc0833d3b80 x1876092510098944/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181569 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181556.839196:0:13332:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789181556.839217:0:13332:0:(pinger.c:399:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789181556.840710:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc0833d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1876092510098816:0@lo:400:kworker.0 00000100:00100000:3.0:1789181556.840868:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc0833d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1876092510098944:0@lo:400:kworker.0 00000100:00080000:2.0:1789181556.841035:0:13332:0:(import.c:65:import_set_state_nolock()) ffff9dc1aa5c2000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1789181556.841152:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0833d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3302:1876092510099200:0@lo:39:umount.0 00000400:00000100:1.0:1789181556.841210:0:3302:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876092510099200 offset 0 length 224: 4 00000100:00100000:0.0:1789181556.841712:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc0833d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1876092510098688:0@lo:400:kworker.0 00010000:00010000:0.0:1789181557.310531:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181558.334569:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789181558.782471:0:706:0:(pinger.c:229:ptlrpc_pinger_process_import()) 880710ad-110c-42a4-a174-ab1b99a7ebeb->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789181558.782482:0:706:0:(pinger.c:247:ptlrpc_pinger_process_import()) 880710ad-110c-42a4-a174-ab1b99a7ebeb->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1789181559.359427:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181560.385272:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181561.408615:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181562.430567:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181563.455373:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789181563.907929:0:706:0:(pinger.c:229:ptlrpc_pinger_process_import()) 880710ad-110c-42a4-a174-ab1b99a7ebeb->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789181563.907940:0:706:0:(pinger.c:247:ptlrpc_pinger_process_import()) 880710ad-110c-42a4-a174-ab1b99a7ebeb->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1789181564.478482:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181565.502668:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181566.016849:0:3302:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789181556/real 1789181556] req@ffff9dc0833d1f80 x1876092510099200/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789181566 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181566.017057:0:3302:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9dc0833d1f80 x1876092510099200/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789181566 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789181566.017079:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9dc1aa5c2000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1789181566.017160:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc0833d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3302:1876092510099200:0@lo:39:umount.0 00000100:00080000:2.0:1789181566.018953:0:13332:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789181566.018960:0:13332:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789181566.018967:0:13332:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1789181566.021654:0:13332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc1ba784600/0x8f4f7840b2e41154 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e4115b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181566.021676:0:13332:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc1ba784600/0x8f4f7840b2e41154 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f4f7840b2e4115b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181566.021685:0:13332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc1ba784600/0x8f4f7840b2e41154 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x8f4f7840b2e4115b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181566.021693:0:13332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.132@tcp lock: ffff9dc1ba784600/0x8f4f7840b2e41154 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x8f4f7840b2e4115b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181566.022166:0:13332:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789181566.022177:0:13332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc1ba784a00/0x8f4f7840b2e41399 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e413a0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181566.022187:0:13332:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc1ba784a00/0x8f4f7840b2e41399 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f4f7840b2e413a0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181566.022193:0:13332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc1ba784a00/0x8f4f7840b2e41399 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x8f4f7840b2e413a0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181566.022199:0:13332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.132@tcp lock: ffff9dc1ba784a00/0x8f4f7840b2e41399 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x8f4f7840b2e413a0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181566.022518:0:13332:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1789181566.022524:0:13332:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1789181566.022554:0:13332:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1789181566.022558:0:13332:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1789181566.022563:0:13332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789181566.022568:0:13332:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789181566.022573:0:13332:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff9dc1c1093380) has no exports 00000020:00080000:2.0:1789181566.022606:0:13332:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff9dc1c1093380) has no exports 00000020:01000000:2.0:1789181566.029951:0:13332:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9dc1898675a0 - data ffff9dc1bfe41af8/ffff9dc1b6c1c400 00000020:01000000:2.0:1789181566.030764:0:13332:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9dc1b64773c0 - data ffff9dc1bff0fa20/ffff9dc1ba9d1400 00010000:00010000:1.0:1789181566.031098:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789181566.031108:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.132@tcp lock: ffff9dc1ba784600/0x8f4f7840b2e41154 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x8f4f7840b2e4115b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181566.031120:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1ba784600 already unused, calling callback (ffffffffc1b45c20) 10000000:00010000:1.0:1789181566.031124:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.132@tcp lock: ffff9dc1ba784600/0x8f4f7840b2e41154 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x8f4f7840b2e4115b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181566.031134:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.132@tcp lock: ffff9dc1ba784600/0x8f4f7840b2e41154 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x8f4f7840b2e4115b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789181566.031142:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.132@tcp lock: ffff9dc1ba784600/0x8f4f7840b2e41154 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x8f4f7840b2e4115b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789181566.031148:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789181566.031151:0:5831:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:1.0:1789181566.031154:0:5831:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:1.0:1789181566.031171:0:5831:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9dc187ae8000 00010000:00010000:1.0:1789181566.031175:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.132@tcp lock: ffff9dc1ba784600/0x8f4f7840b2e41154 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x8f4f7840b2e4115b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181566.031182:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.132@tcp lock: ffff9dc1ba784600/0x8f4f7840b2e41154 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x8f4f7840b2e4115b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181566.033495:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789181566.033508:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.132@tcp lock: ffff9dc1ba784a00/0x8f4f7840b2e41399 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x8f4f7840b2e413a0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181566.033518:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1ba784a00 already unused, calling callback (ffffffffc1b45c20) 10000000:00010000:2.0:1789181566.033522:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.132@tcp lock: ffff9dc1ba784a00/0x8f4f7840b2e41399 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x8f4f7840b2e413a0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181566.033530:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.132@tcp lock: ffff9dc1ba784a00/0x8f4f7840b2e41399 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x8f4f7840b2e413a0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789181566.033535:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.132@tcp lock: ffff9dc1ba784a00/0x8f4f7840b2e41399 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x8f4f7840b2e413a0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789181566.033540:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1789181566.033543:0:5831:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1789181566.033545:0:5831:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1789181566.033565:0:5831:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9dc187ae8000 00010000:00010000:2.0:1789181566.033569:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.132@tcp lock: ffff9dc1ba784a00/0x8f4f7840b2e41399 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x8f4f7840b2e413a0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181566.033930:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.132@tcp lock: ffff9dc1ba784a00/0x8f4f7840b2e41399 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x8f4f7840b2e413a0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181566.033949:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181566.033951:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181566.033954:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181566.036806:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1789181566.048061:0:13332:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1789181566.076083:0:13332:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8f4f7840b2e4104a 00000020:00000080:1.0:1789181566.076098:0:13332:0:(genops.c:885:class_export_put()) final put ffff9dc1bfb9d000/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1789181566.076276:0:10892:0:(genops.c:844:class_export_destroy()) destroying export ffff9dc1bfb9d000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000004:1.0:1789181566.076289:0:13332:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dc08132f800 from lustre-OST0001, refs=2 00000020:01000004:1.0:1789181566.076293:0:13332:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dc08132f800 2 00000020:01000004:1.0:1789181566.076296:0:13332:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9dc08132f800 from lustre-OST0001 00000020:00000080:1.0:1789181566.076318:0:13332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789181566.076327:0:13332:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1789181566.076385:0:13332:0:(genops.c:885:class_export_put()) final put ffff9dc1bfb9c000/lustre-OST0001_UUID 00000020:00000080:1.0:1789181566.076388:0:13332:0:(genops.c:844:class_export_destroy()) destroying export ffff9dc1bfb9c000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1789181566.076395:0:13332:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:1.0:1789181566.076609:0:13332:0:(pinger.c:399:ptlrpc_pinger_del_import()) removing pingable import 880710ad-110c-42a4-a174-ab1b99a7ebeb->MGS 00010000:00010000:1.0:1789181566.076627:0:13332:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.132@tcp lock: ffff9dc18151a400/0x8f4f7840b2e40f5c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x8f4f7840b2e40f63 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789181566.076639:0:13332:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.132@tcp lock: ffff9dc18151a400/0x8f4f7840b2e40f5c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x8f4f7840b2e40f63 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789181566.076645:0:13332:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1789181566.076647:0:13332:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1789181566.076650:0:13332:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1789181566.076664:0:13332:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9dc187ae8000 00010000:00010000:1.0:1789181566.076669:0:13332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.132@tcp lock: ffff9dc18151a400/0x8f4f7840b2e40f5c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x8f4f7840b2e40f63 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181566.076682:0:13332:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.132@tcp lock: ffff9dc1ba785000/0x8f4f7840b2e4119a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x8f4f7840b2e411a1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789181566.076689:0:13332:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.132@tcp lock: ffff9dc1ba785000/0x8f4f7840b2e4119a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x8f4f7840b2e411a1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789181566.076693:0:13332:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789181566.076695:0:13332:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1789181566.076702:0:13332:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1789181566.076712:0:13332:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9dc187ae8000 00010000:00010000:1.0:1789181566.076714:0:13332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.132@tcp lock: ffff9dc1ba785000/0x8f4f7840b2e4119a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x8f4f7840b2e411a1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789181566.076731:0:13332:0:(import.c:65:import_set_state_nolock()) ffff9dc187ae8000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1789181566.076735:0:13332:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1789181566.076737:0:13332:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1789181566.076739:0:13332:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1789181566.076743:0:13332:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1789181566.076754:0:13332:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dc1c01c5180 x1876092510099072/t0(0) o250->MGC192.168.204.132@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789181568 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1789181566.077152:0:13332:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1789181566.077155:0:13332:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 2s for inflight to error out 00000100:00100000:0.0:1789181566.077287:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c01c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:880710ad-110c-42a4-a174-ab1b99a7ebeb:3302:1876092510099072:0@lo:250:kworker.0 10000000:01000000:1.0:1789181566.078254:0:13332:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1789181566.078264:0:13332:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8f4f7840b2e40e3d 00000020:00000080:1.0:1789181566.078270:0:13332:0:(genops.c:885:class_export_put()) final put ffff9dc187aea800/880710ad-110c-42a4-a174-ab1b99a7ebeb 00000020:01000000:1.0:1789181566.078282:0:13332:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.204.132@tcp (flags='') 00000020:00000080:1.0:1789181566.078291:0:10892:0:(genops.c:844:class_export_destroy()) destroying export ffff9dc187aea800/880710ad-110c-42a4-a174-ab1b99a7ebeb for MGC192.168.204.132@tcp 00000020:00000080:1.0:1789181566.078303:0:13332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789181566.078309:0:13332:0:(obd_config.c:956:class_cleanup()) MGC192.168.204.132@tcp: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789181566.078313:0:13332:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff9dc18851cd40) has no exports 10000000:01000000:3.0:1789181566.078438:0:5840:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1789181566.078594:0:13332:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.204.132@tcp: client import never connected 00000100:00080000:1.0:1789181566.078598:0:13332:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1789181566.078600:0:13332:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1789181566.078602:0:13332:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1789181566.078604:0:13332:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1789181566.078626:0:10892:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9dc187ae8000 for MGC192.168.204.132@tcp 00000020:00000080:1.0:1789181566.078659:0:13332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789181566.078664:0:13332:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.132@tcp (uuid 880710ad-110c-42a4-a174-ab1b99a7ebeb) 00000020:00000080:1.0:1789181566.078728:0:13332:0:(genops.c:885:class_export_put()) final put ffff9dc187aed000/880710ad-110c-42a4-a174-ab1b99a7ebeb 00000020:00000080:1.0:1789181566.078731:0:13332:0:(genops.c:844:class_export_destroy()) destroying export ffff9dc187aed000/880710ad-110c-42a4-a174-ab1b99a7ebeb for MGC192.168.204.132@tcp 00000020:01000000:1.0:1789181566.078973:0:13332:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.132@tcp (880710ad-110c-42a4-a174-ab1b99a7ebeb) 00000020:01000000:1.0:1789181566.080641:0:13332:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1789181566.080648:0:13332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789181566.080658:0:13332:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789181566.080665:0:13332:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9dc1aa5c1800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789181566.080670:0:13332:0:(genops.c:1552:class_disconnect_exports()) OBD device 16 (ffff9dc1c1090000) has exports, disconnecting them 00000020:00080000:1.0:1789181566.080675:0:13332:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9dc1aa5c1800), last request at 1789181349 00000020:00000080:1.0:1789181566.080679:0:13332:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8f4f7840b2e41074 00000020:00080000:1.0:1789181566.080692:0:13332:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dc1aa5c1800): rc 0 00000020:00000080:1.0:1789181566.080696:0:13332:0:(genops.c:885:class_export_put()) final put ffff9dc1aa5c1800/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1789181566.080724:0:10892:0:(genops.c:844:class_export_destroy()) destroying export ffff9dc1aa5c1800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1789181566.085494:0:13332:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1789181566.085510:0:13332:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789181566.085514:0:13332:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789181566.085523:0:13332:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789181566.085555:0:706:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9dc1aa5c2000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:3.0:1789181566.085804:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1789181566.086100:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000100:00100000:0.0:1789181566.086318:0:5826:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9dc1aa577200:5826] 1 exiting: rc = 0 00000100:00100000:3.0:1789181566.086471:0:5825:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9dc1aa576200:5825] 0 exiting: rc = 1 00000100:00100000:0.0:1789181566.086566:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.086858:0:5828:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9dc1aa576000:5828] 1 exiting: rc = 0 00000100:00100000:3.0:1789181566.086909:0:5827:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9dc1aa576e00:5827] 0 exiting: rc = 1 00000100:00100000:0.0:1789181566.087404:0:8456:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_004: service thread [ffff9dc1b66d5400:8456] 4 exiting: rc = 0 00000100:00100000:3.0:1789181566.088412:0:6707:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9dc1bfc01800:6707] 3 exiting: rc = 0 00000100:00100000:3.0:1789181566.089505:0:5829:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9dc1aa577a00:5829] 2 exiting: rc = 0 00000100:00100000:0.0:1789181566.089612:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.089621:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.089627:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.089632:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.089638:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.089644:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.089651:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.089657:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.089666:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.089673:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.089679:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.089685:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.089691:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.089697:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.089702:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.089708:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.089715:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.089721:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.089726:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.089732:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.089737:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.089742:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.089746:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.089751:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.089761:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.089766:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.089783:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.089791:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.089796:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.089801:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.089806:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.089906:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.089912:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.089917:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.089943:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.089947:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.089953:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.089958:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.089963:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.089967:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.090051:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.090056:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.090061:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.090066:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.090070:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.090075:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.090079:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.090084:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.090088:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.090093:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.090098:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.090102:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.090107:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.090112:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.090117:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.090121:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.090126:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.090131:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.090136:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.090140:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.090145:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.090150:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.090155:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.090160:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1789181566.092771:0:13332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789181566.092790:0:13332:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1789181566.092796:0:13332:0:(genops.c:885:class_export_put()) final put ffff9dc1bfb9f000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1789181566.092801:0:13332:0:(genops.c:844:class_export_destroy()) destroying export ffff9dc1bfb9f000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1789181566.092829:0:13332:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:3.0:1789181566.092875:0:13332:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dc08132f800 1 00000020:00000080:3.0:1789181566.092883:0:13332:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8f4f7840b2e41019 00000020:00000080:3.0:1789181566.092890:0:13332:0:(genops.c:885:class_export_put()) final put ffff9dc1c1dc4000/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1789181566.092901:0:13332:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1789181566.092911:0:11922:0:(genops.c:844:class_export_destroy()) destroying export ffff9dc1c1dc4000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1789181566.092921:0:13332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789181566.092926:0:13332:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789181566.092930:0:13332:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff9dc18981cd40) has no exports 00000020:00000080:0.0:1789181566.114391:0:13332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789181566.114407:0:13332:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1789181566.114413:0:13332:0:(genops.c:885:class_export_put()) final put ffff9dc1c1dc7000/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1789181566.114417:0:13332:0:(genops.c:844:class_export_destroy()) destroying export ffff9dc1c1dc7000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1789181566.114426:0:13332:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1789181566.114603:0:13332:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9dc189d1c800 00000020:01000000:0.0:1789181566.114625:0:13332:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1789181566.114628:0:13332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789181566.114633:0:13332:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789181566.114636:0:13332:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff9dc1898bcd40) has no exports 00000020:00000080:0.0:1789181566.114655:0:13332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789181566.114660:0:13332:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1789181566.114662:0:13332:0:(genops.c:885:class_export_put()) final put ffff9dc1b66e0000/OSS_uuid 00000020:00000080:0.0:1789181566.114664:0:13332:0:(genops.c:844:class_export_destroy()) destroying export ffff9dc1b66e0000/OSS_uuid for OSS 00000020:01000000:0.0:1789181566.114667:0:13332:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:3.0:1789181566.120475:0:6693:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff9dc1c02ccc00:6693] 2 exiting: rc = 0 00000100:00100000:3.0:1789181566.120572:0:6692:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff9dc189c61a00:6692] 1 exiting: rc = 0 00000100:00080000:3.0:1789181566.120605:0:5838:0:(pinger.c:550:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1789181566.121483:0:6894:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff9dc18611b000:6894] 3 exiting: rc = 0 00000100:00100000:2.0:1789181566.121586:0:6691:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff9dc1c02cd400:6691] 0 exiting: rc = 1 00000100:00100000:0.0:1789181566.122677:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.122688:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.122694:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.122700:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.122705:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.122710:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.122716:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.122721:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.122726:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.122732:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.122738:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.122743:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.122748:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.122753:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.122758:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.122763:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.122769:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.122784:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.122789:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.122794:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.122800:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.122805:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.122818:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.122823:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.122828:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.122848:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.122861:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.122866:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.122871:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.122877:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.122882:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.122886:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.122891:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.122896:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.122900:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.122905:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.122909:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.122914:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.122919:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.122924:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.122929:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.122934:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.122943:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.122948:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.122952:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.122958:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.122963:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.123081:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.123089:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.123094:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.123099:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.123104:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.123110:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.123115:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.123120:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.123125:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.123130:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.123136:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.123141:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.123147:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.123160:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.123165:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.123170:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.123175:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.124704:0:6696:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9dc1c02cf400:6696] 1 exiting: rc = 0 00000100:00100000:0.0:1789181566.124899:0:6694:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9dc1c02cee00:6694] 0 exiting: rc = 1 00000100:00100000:3.0:1789181566.125617:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.125625:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.125630:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.125636:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.125641:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.125646:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.125652:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.125657:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.125662:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.125668:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.125674:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.125678:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.125683:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.125687:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.125693:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.125698:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.125703:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.125708:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.125712:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.125716:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.125733:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.125738:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.125743:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.125748:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.125752:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.125757:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.125763:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.125768:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.125783:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.125789:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.125794:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.125799:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.125804:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.125878:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.125885:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.125891:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.125896:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.125901:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.125906:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.125912:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.125916:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.125921:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.125926:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.125931:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.125936:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.125941:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.125946:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.125952:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.125957:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.125961:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.125966:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.126041:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.126046:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.126050:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.126055:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.126068:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.126073:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.126077:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.126083:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.126088:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.126093:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.126097:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.126102:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.126112:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.127578:0:6699:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9dc1c049ac00:6699] 2 exiting: rc = 0 00000100:00100000:0.0:1789181566.127859:0:6697:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9dc1add3ea00:6697] 0 exiting: rc = 1 00000100:00100000:0.0:1789181566.128023:0:6698:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9dc1c049b000:6698] 1 exiting: rc = 0 00000100:00100000:3.0:1789181566.128365:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.128374:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.128379:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.128387:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.128393:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.128398:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.128404:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.128410:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.128415:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.128421:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.128427:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.128451:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.128459:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.128465:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.128471:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.128476:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.128482:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.128487:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.128493:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.128498:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.128503:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.128508:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.128514:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.128520:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.128526:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.128547:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.128552:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.128558:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.128564:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.128569:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.128575:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.128581:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.128587:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.128592:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.128598:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.128618:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.128624:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.128630:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.128635:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.128641:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.128647:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.128652:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.128658:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.128663:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.128669:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.128675:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.128680:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.128687:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.128692:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.128697:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.128703:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.128708:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.128714:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.128720:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.128725:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.128730:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.128735:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.128740:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.128747:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.128752:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.128788:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.128797:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.128803:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.128818:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.135390:0:6700:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9dc1c02ce400:6700] 0 exiting: rc = 1 00000100:00100000:0.0:1789181566.135506:0:6701:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9dc1c02cf600:6701] 1 exiting: rc = 0 00000100:00100000:3.0:1789181566.135679:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.135686:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.135691:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.135695:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.135700:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.135705:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.135710:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.135714:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.135719:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.135724:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.135728:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.135733:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.135738:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.135743:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.135748:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.135752:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.135757:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.135762:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.135768:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.135784:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.135790:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.135795:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.135800:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.135804:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.135819:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.135824:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.135828:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.135833:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.135838:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.135843:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.135848:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.135867:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.135871:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.135877:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.135883:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.135888:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.135893:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.135897:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.135902:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.135906:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.135911:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.135915:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.135920:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.135925:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.135929:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.135933:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.135939:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.135944:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.135949:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.135954:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.135959:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.135963:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.135980:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.135986:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.135991:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.135996:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.136000:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.136006:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.136010:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.136015:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.136019:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.136024:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.136029:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789181566.136033:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.137367:0:6702:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9dc1c049a400:6702] 0 exiting: rc = 1 00000100:00100000:3.0:1789181566.137507:0:6703:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9dc1c1db8000:6703] 1 exiting: rc = 0 00000100:00100000:0.0:1789181566.137657:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.137673:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.137682:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.137687:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.137694:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.137700:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.137722:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.137729:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.137736:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.137742:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.137748:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.137754:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.137760:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.137767:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.137784:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.137790:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.137796:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.137802:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.137834:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.137843:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.137850:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.137857:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.137864:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.137870:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.137889:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.137895:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.137902:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.137910:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.137917:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.137924:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.137947:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.137955:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.137966:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.137986:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.137992:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.137997:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.138003:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.138008:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.138013:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.138019:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.138024:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.138029:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.138050:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.138057:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.138062:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.138067:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.138072:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.138077:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.138082:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.138087:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.138094:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.138099:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.138105:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.138110:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.138127:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.138134:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.138139:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.138144:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.138155:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.138168:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.138650:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.138662:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.138668:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789181566.138674:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1789181566.152885:0:13332:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1789181583.626276:0:13945:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg432-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1789181591.619641:0:14405:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789181591.619645:0:14405:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1789181591.619759:0:14405:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9dc1ba454000 00000020:01000004:0.0:1789181591.619775:0:14405:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1789181591.619783:0:14405:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1789181591.619797:0:14405:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9dc189d14d40) 00000020:00000080:0.0:1789181591.619810:0:14405:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1789181591.640550:0:14405:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1789181591.647103:0:14405:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:0.0:1789181591.650073:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 391: rc = 0 00100000:10000000:1.0:1789181591.651837:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 391: rc = 0 00100000:10000000:1.0:1789181591.651975:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 391: rc = 0 00100000:10000000:1.0:1789181591.652060:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 391: rc = 0 00100000:10000000:1.0:1789181591.652242:0:14405:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1789181591.653789:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 391: rc = 0 00100000:10000000:1.0:1789181591.653927:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 391: rc = 0 00100000:10000000:1.0:1789181591.654192:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 393: rc = 0 00100000:10000000:1.0:1789181591.655231:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 87: rc = 0 00100000:10000000:1.0:1789181591.655374:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 87: rc = 0 00100000:10000000:1.0:1789181591.659958:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 540: rc = 0 00100000:10000000:1.0:1789181591.660789:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 540: rc = 0 00100000:10000000:1.0:1789181591.661047:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 540: rc = 0 00100000:10000000:1.0:1789181591.661914:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 540: rc = 0 00100000:10000000:1.0:1789181591.662198:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 540: rc = 0 00100000:10000000:1.0:1789181591.667945:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 540: rc = 0 00100000:10000000:1.0:1789181591.669774:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 540: rc = 0 00100000:10000000:1.0:1789181591.671831:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 540: rc = 0 00100000:10000000:1.0:1789181591.672122:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 540: rc = 0 00100000:10000000:1.0:1789181591.672722:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 540: rc = 0 00100000:10000000:1.0:1789181591.672967:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 540: rc = 0 00100000:10000000:1.0:1789181591.673235:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 540: rc = 0 00100000:10000000:1.0:1789181591.675258:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 652: rc = 0 00100000:10000000:1.0:1789181591.677063:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 652: rc = 0 00100000:10000000:1.0:1789181591.678790:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 652: rc = 0 00100000:10000000:1.0:1789181591.679080:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 652: rc = 0 00100000:10000000:2.0:1789181591.691087:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 652: rc = 0 00100000:10000000:2.0:1789181591.691430:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 652: rc = 0 00100000:10000000:2.0:1789181591.695112:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 652: rc = 0 00100000:10000000:2.0:1789181591.695447:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 652: rc = 0 00100000:10000000:2.0:1789181591.695702:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 652: rc = 0 00100000:10000000:2.0:1789181591.695947:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 652: rc = 0 00100000:10000000:2.0:1789181591.696196:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 652: rc = 0 00100000:10000000:2.0:1789181591.696505:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 652: rc = 0 00100000:10000000:2.0:1789181591.696760:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 652: rc = 0 00100000:10000000:2.0:1789181591.701177:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 652: rc = 0 00100000:10000000:2.0:1789181591.704116:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 652: rc = 0 00100000:10000000:2.0:1789181591.704544:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 652: rc = 0 00100000:10000000:2.0:1789181591.704792:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 652: rc = 0 00100000:10000000:2.0:1789181591.705040:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 652: rc = 0 00100000:10000000:2.0:1789181591.705283:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 652: rc = 0 00100000:10000000:2.0:1789181591.705588:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 652: rc = 0 00100000:10000000:2.0:1789181591.705859:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 652: rc = 0 00100000:10000000:2.0:1789181591.714037:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 652: rc = 0 00100000:10000000:2.0:1789181591.714546:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 652: rc = 0 00100000:10000000:2.0:1789181591.715037:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 652: rc = 0 00100000:10000000:2.0:1789181591.715310:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 652: rc = 0 00100000:10000000:2.0:1789181591.715619:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 652: rc = 0 00100000:10000000:2.0:1789181591.715863:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 652: rc = 0 00100000:10000000:2.0:1789181591.716144:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 652: rc = 0 00100000:10000000:2.0:1789181591.717595:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 652: rc = 0 00100000:10000000:2.0:1789181591.718213:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 652: rc = 0 00100000:10000000:2.0:1789181591.719893:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 652: rc = 0 00100000:10000000:2.0:1789181591.720186:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 652: rc = 0 00100000:10000000:2.0:1789181591.721252:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 641: rc = 0 00100000:10000000:2.0:1789181591.723106:0:14405:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1789181591.723281:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 88: rc = 0 00100000:10000000:2.0:1789181591.724081:0:14405:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1789181591.724158:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 88: rc = 0 00100000:10000000:2.0:1789181591.724587:0:14405:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1789181591.725232:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 88: rc = 0 00100000:10000000:2.0:1789181591.725968:0:14405:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1789181591.726035:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 500: rc = 0 00100000:10000000:2.0:1789181591.726242:0:14405:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1789181591.726409:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 500: rc = 0 00100000:10000000:2.0:1789181591.726757:0:14405:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1789181591.726836:0:14405:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 500: rc = 0 00000020:00000080:2.0:1789181591.727108:0:14405:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1789181591.727116:0:14405:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789181591.727133:0:14405:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8f4f7840b2e42130 00000020:01000004:2.0:1789181591.727142:0:14405:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1789181591.727146:0:14405:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1789181591.727151:0:14405:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9dc1ba454000 from MGS 00000020:01000004:2.0:1789181591.727155:0:14405:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1789181591.727165:0:14405:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9dc1babccd40) 00000020:00000080:2.0:1789181591.727175:0:14405:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1789181591.727229:0:14405:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dc1ba454000 from MGS, refs=2 00080000:01000000:2.0:1789181591.727234:0:14405:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789181591.727239:0:14405:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8f4f7840b2e4213e 00000100:00100000:2.0:1789181591.727537:0:14405:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1789181591.727952:0:14405:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1789181591.727960:0:14405:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1789181591.729467:0:14405:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1789181591.729478:0:14405:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1789181591.733234:0:14405:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789181591.733861:0:14405:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1789181591.733869:0:14405:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1789181591.735127:0:14405:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1789181591.735137:0:14405:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1789181591.735894:0:14405:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1789181591.735902:0:14405:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1789181591.736979:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181591.736984:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181591.736986:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181591.737466:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181591.739526:0:14405:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1789181591.748832:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181591.751418:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181591.751426:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1789181591.786707:0:14405:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1789181591.786726:0:14405:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789181591.786729:0:14405:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1789181591.792776:0:14414:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1789181591.792993:0:14405:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1789181591.793100:0:14405:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789181591.795823:0:14405:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1789181591.796117:0:14405:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789181591.796618:0:14405:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1789181591.796625:0:14405:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1789181591.797108:0:14405:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1789181591.797114:0:14405:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1789181591.797571:0:14405:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1789181591.797576:0:14405:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1789181591.798416:0:14405:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1789181591.798437:0:14405:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.132@tcp' 00000020:01000004:3.0:1789181591.798439:0:14405:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1789181591.798466:0:14405:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.132@tcp (typ=mgc) 00000020:00000080:3.0:1789181591.798479:0:14405:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.132@tcp (ffff9dc18981b380) 00000020:00000080:3.0:1789181591.798493:0:14405:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1789181591.798561:0:14405:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dc0827d9000@MGC192.168.204.132@tcp: add connection 192.168.204.132@tcp at head 00010000:00010000:3.0:1789181591.798700:0:14405:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.132@tcp-0 is initialized 00000040:01000000:3.0:1789181591.798706:0:14405:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.132@tcp ctxt 1 is initialized 10000000:01000000:3.0:1789181591.799042:0:14420:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1789181591.799099:0:14405:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.132@tcp (uuid 486954f1-c2e6-402a-b3c8-096af476560c) 00000020:00000080:2.0:1789181591.799117:0:14405:0:(genops.c:1384:class_connect()) connect: client 486954f1-c2e6-402a-b3c8-096af476560c, cookie 0x8f4f7840b2e4214c 00000100:00080000:2.0:1789181591.799126:0:14405:0:(import.c:545:import_select_connection()) MGC192.168.204.132@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789181591.799133:0:14405:0:(import.c:666:import_select_connection()) MGC192.168.204.132@tcp: import ffff9dc0827d9000 using connection 192.168.204.132@tcp/0@lo 00000100:00100000:2.0:1789181591.799163:0:14405:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc0833d1880 x1876092510099328/t0(0) o250->MGC192.168.204.132@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789181591.799183:0:14405:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import 486954f1-c2e6-402a-b3c8-096af476560c->MGS 00000020:01000004:2.0:1789181591.799215:0:14405:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1789181591.799219:0:14405:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1789181591.799228:0:14405:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9dc1babc8000) 00000020:00000080:2.0:1789181591.799237:0:14405:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1789181591.799471:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0833d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:486954f1-c2e6-402a-b3c8-096af476560c:3302:1876092510099328:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1789181591.799535:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181591.799598:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510099328 00000100:00100000:0.0:1789181591.799605:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510099328 00000100:00100000:0.0:1789181591.799707:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789181591.799716:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bba0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3302:x1876092510099328:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1789181591.799738:0:14416:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 486954f1-c2e6-402a-b3c8-096af476560c@0@lo t0 exp 0000000000000000 cur 484 last 0 00000020:00000080:0.0:1789181591.799759:0:14416:0:(genops.c:1384:class_connect()) connect: client 486954f1-c2e6-402a-b3c8-096af476560c, cookie 0x8f4f7840b2e4215a 00000100:00080000:0.0:1789181591.799945:0:14416:0:(import.c:65:import_set_state_nolock()) ffff9dc1ba453800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789181591.799997:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bba0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:486954f1-c2e6-402a-b3c8-096af476560c+5:3302:x1876092510099328:12345-0@lo:250:mount.lustre.0 Request processed in 280us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181591.800016:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789181591.800122:0:3302:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.204.132@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1789181591.800130:0:3302:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.204.132@tcp: connect to target with instance 0 00000100:00080000:0.0:1789181591.800137:0:3302:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.204.132@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1789181591.800142:0:3302:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1789181591.800145:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9dc0827d9000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1789181591.800148:0:3302:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1789181591.800158:0:3302:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1789181591.800164:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc0833d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:486954f1-c2e6-402a-b3c8-096af476560c:3302:1876092510099328:0@lo:250:mount.lustre.0 00000100:00080000:1.0:1789181591.804585:0:14419:0:(pinger.c:468:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:2.0:1789181591.811604:0:14405:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789181591.811793:0:14405:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1789181591.811798:0:14405:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1789181591.813015:0:14405:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1789181591.813024:0:14405:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1789181591.813420:0:14405:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1789181591.813427:0:14405:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1789181591.814157:0:14405:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789181591.814437:0:14405:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1789181591.814443:0:14405:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1789181591.815225:0:14405:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1789181591.815234:0:14405:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1789181591.844440:0:14405:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789181591.844646:0:14405:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1789181591.844651:0:14405:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1789181591.845609:0:14405:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1789181591.845618:0:14405:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1789181591.846128:0:14405:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789181591.846311:0:14405:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789181591.846316:0:14405:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1789181591.847058:0:14405:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789181591.847065:0:14405:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1789181591.847745:0:14405:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789181591.847923:0:14405:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789181591.847929:0:14405:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1789181591.848430:0:14405:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789181591.848438:0:14405:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1789181591.849085:0:14405:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789181591.849240:0:14405:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789181591.849246:0:14405:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1789181591.850128:0:14405:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789181591.850136:0:14405:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1789181591.870580:0:14405:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789181591.871039:0:14405:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789181591.871045:0:14405:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1789181591.872239:0:14405:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789181591.872248:0:14405:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1789181591.873939:0:14405:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1789181591.873951:0:14405:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1789181591.875053:0:14405:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1789181591.875081:0:14405:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1789181591.875088:0:14405:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.132@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1789181591.875236:0:14405:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.132@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789181591.875269:0:14405:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.132@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1789181591.875274:0:14405:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789181591.875276:0:14405:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789181591.875277:0:14405:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789181591.875279:0:14405:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789181591.875280:0:14405:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789181591.875292:0:14405:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789181591.875293:0:14405:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789181591.875295:0:14405:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789181591.875297:0:14405:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789181591.875298:0:14405:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789181591.875300:0:14405:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1789181591.875302:0:14405:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789181591.875304:0:14405:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789181591.875305:0:14405:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789181591.875306:0:14405:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789181591.875307:0:14405:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789181591.875308:0:14405:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789181591.875309:0:14405:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789181591.875310:0:14405:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789181591.875311:0:14405:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789181591.875312:0:14405:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789181591.875542:0:14405:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1789181591.875568:0:14405:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1988c3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:14405:1876092510099456:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789181591.875650:0:14405:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181591.875733:0:14405:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc0821f4cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789181591.875908:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510099456 00000100:00100000:1.0:1789181591.875916:0:14418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510099456 00000100:00100000:1.0:1789181591.876001:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789181591.876011:0:14418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bba0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:486954f1-c2e6-402a-b3c8-096af476560c+5:14405:x1876092510099456:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789181591.876056:0:14418:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789181591.876059:0:14418:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1789181591.876062:0:14418:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1789181591.876496:0:14439:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1789181591.877000:0:14418:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:2.0:1789181591.878178:0:14440:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1789181591.878185:0:14440:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1789181591.878188:0:14440:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1789181591.878223:0:14440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:1.0:1789181591.878997:0:14418:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789181591.879010:0:14418:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1789181591.894556:0:14418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bba0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:486954f1-c2e6-402a-b3c8-096af476560c+5:14405:x1876092510099456:12345-0@lo:253:mount.lustre.0 Request processed in 18538us (18896us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181591.894573:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789181591.894659:0:14405:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1988c3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:14405:1876092510099456:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789181591.894674:0:14405:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1789181591.894677:0:14405:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789181591.894679:0:14405:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789181591.894680:0:14405:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789181591.894681:0:14405:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789181591.894682:0:14405:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789181591.894684:0:14405:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789181591.894685:0:14405:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789181591.894698:0:14405:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789181591.894700:0:14405:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789181591.894701:0:14405:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789181591.894718:0:14405:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9dc1ba454000 from lustre-MDT0000 10000000:01000000:3.0:1789181591.894750:0:14405:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1789181591.894753:0:14405:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789181591.894757:0:14405:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9dc18981b380 10000000:01000000:3.0:1789181591.894761:0:14405:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789181591.894769:0:14405:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9dc18981b380 from 1 10000000:01000000:3.0:1789181591.894772:0:14405:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789181591.894808:0:14405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1f000/0x8f4f7840b2e42161 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181591.894820:0:14405:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1f000/0x8f4f7840b2e42161 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181591.894830:0:14405:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1f000/0x8f4f7840b2e42161 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181591.894849:0:14405:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1988c3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:14405:1876092510099584:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789181591.894886:0:14405:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181591.894957:0:14405:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc0821f4cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789181591.894991:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510099584 00000100:00100000:0.0:1789181591.894997:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510099584 00000100:00100000:0.0:1789181591.895163:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789181591.895173:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bba0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:486954f1-c2e6-402a-b3c8-096af476560c+5:14405:x1876092510099584:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789181591.895197:0:14417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181591.895212:0:14417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc189891000/0x8f4f7840b2e42168 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f4f7840b2e42161 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181591.895236:0:14417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc189891000/0x8f4f7840b2e42168 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f4f7840b2e42161 expref: 6 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181591.895245:0:14417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc189891000/0x8f4f7840b2e42168 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e42161 expref: 6 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181591.895265:0:14417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc189891000, rc 0) 00000100:00100000:0.0:1789181591.895324:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bba0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:486954f1-c2e6-402a-b3c8-096af476560c+6:14405:x1876092510099584:12345-0@lo:101:mount.lustre.0 Request processed in 146us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181591.895356:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789181591.895445:0:14405:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1988c3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:14405:1876092510099584:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789181591.895459:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1f000/0x8f4f7840b2e42161 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e42168 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181591.895467:0:14405:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1f000/0x8f4f7840b2e42161 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f4f7840b2e42168 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181591.895514:0:14405:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1988c3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:14405:1876092510099712:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789181591.895549:0:14405:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181591.895773:0:14405:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc0821f4cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789181591.895910:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510099712 00000100:00100000:1.0:1789181591.895915:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510099712 00000100:00100000:1.0:1789181591.895944:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789181591.895951:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bba0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:486954f1-c2e6-402a-b3c8-096af476560c+6:14405:x1876092510099712:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789181591.896756:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bba0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:486954f1-c2e6-402a-b3c8-096af476560c+6:14405:x1876092510099712:12345-0@lo:501:mount.lustre.0 Request processed in 803us (1203us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789181591.896766:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789181591.896835:0:14405:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1988c3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:14405:1876092510099712:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789181591.896870:0:14405:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.132@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789181591.896884:0:14405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1f000/0x8f4f7840b2e42161 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e42168 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181591.896894:0:14405:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1f000/0x8f4f7840b2e42161 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e42168 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789181591.896903:0:14405:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9dc1ba454000 10000000:01000000:3.0:1789181591.896907:0:14405:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789181591.896912:0:14405:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9dc1ba454000 10000000:01000000:3.0:1789181591.896914:0:14405:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1789181591.896918:0:14405:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9dc1ba454000 from 1 10000000:01000000:3.0:1789181591.896920:0:14405:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1789181591.896944:0:14405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1f600/0x8f4f7840b2e4216f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181591.896952:0:14405:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1f600/0x8f4f7840b2e4216f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181591.896960:0:14405:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1f600/0x8f4f7840b2e4216f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181591.896976:0:14405:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1988c3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:14405:1876092510099840:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789181591.897008:0:14405:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181591.897129:0:14405:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc0821f4cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789181591.897164:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510099840 00000100:00100000:0.0:1789181591.897170:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510099840 00000100:00100000:0.0:1789181591.897471:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789181591.897482:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bba0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:486954f1-c2e6-402a-b3c8-096af476560c+6:14405:x1876092510099840:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789181591.897493:0:14417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181591.897506:0:14417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc189891a00/0x8f4f7840b2e42176 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f4f7840b2e4216f expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181591.897527:0:14417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc189891a00/0x8f4f7840b2e42176 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f4f7840b2e4216f expref: 7 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181591.897538:0:14417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc189891a00/0x8f4f7840b2e42176 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e4216f expref: 7 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181591.897546:0:14417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc189891a00, rc 0) 00000100:00100000:0.0:1789181591.897590:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bba0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:486954f1-c2e6-402a-b3c8-096af476560c+7:14405:x1876092510099840:12345-0@lo:101:mount.lustre.0 Request processed in 111us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181591.897597:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789181591.897654:0:14405:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1988c3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:14405:1876092510099840:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789181591.897677:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1f600/0x8f4f7840b2e4216f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e42176 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181591.897685:0:14405:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1f600/0x8f4f7840b2e4216f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f4f7840b2e42176 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789181591.897697:0:14405:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.132@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1789181591.897706:0:14405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1f600/0x8f4f7840b2e4216f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e42176 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181591.897713:0:14405:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1f600/0x8f4f7840b2e4216f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e42176 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789181591.897720:0:14405:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789181591.897723:0:14405:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789181591.897728:0:14405:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9dc1ba454000 10000000:01000000:3.0:1789181591.897731:0:14405:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1789181591.897734:0:14405:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1789181591.897736:0:14405:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789181591.897752:0:14405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1e600/0x8f4f7840b2e4217d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181591.897759:0:14405:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1e600/0x8f4f7840b2e4217d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181591.897767:0:14405:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1e600/0x8f4f7840b2e4217d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181591.897781:0:14405:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1988c3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:14405:1876092510099968:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789181591.897818:0:14405:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181591.898062:0:14405:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc0821f4cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789181591.898145:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510099968 00000100:00100000:2.0:1789181591.898151:0:14418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510099968 00000100:00100000:0.0:1789181591.898249:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789181591.898256:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bba0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:486954f1-c2e6-402a-b3c8-096af476560c+7:14405:x1876092510099968:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789181591.898264:0:14417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181591.898273:0:14417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc189890200/0x8f4f7840b2e42184 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f4f7840b2e4217d expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181591.898307:0:14417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc189890200/0x8f4f7840b2e42184 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f4f7840b2e4217d expref: 8 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181591.898316:0:14417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc189890200/0x8f4f7840b2e42184 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e4217d expref: 8 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181591.898354:0:14417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc189890200, rc 0) 00000100:00100000:0.0:1789181591.898388:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bba0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:486954f1-c2e6-402a-b3c8-096af476560c+8:14405:x1876092510099968:12345-0@lo:101:mount.lustre.0 Request processed in 132us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181591.898394:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789181591.898462:0:14405:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1988c3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:14405:1876092510099968:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789181591.898472:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1e600/0x8f4f7840b2e4217d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e42184 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181591.898480:0:14405:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1e600/0x8f4f7840b2e4217d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f4f7840b2e42184 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181591.898525:0:14405:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1988c3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:14405:1876092510100096:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789181591.898551:0:14405:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181591.898739:0:14405:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc0821f4cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789181591.898768:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510100096 00000100:00100000:1.0:1789181591.898772:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510100096 00000100:00100000:1.0:1789181591.898793:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789181591.898799:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bba0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:486954f1-c2e6-402a-b3c8-096af476560c+8:14405:x1876092510100096:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789181591.899187:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bba0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:486954f1-c2e6-402a-b3c8-096af476560c+9:14405:x1876092510100096:12345-0@lo:501:mount.lustre.0 Request processed in 379us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181591.899195:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789181591.899370:0:14405:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1988c3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:14405:1876092510100096:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789181591.899399:0:14405:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1988c3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:14405:1876092510100224:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789181591.899438:0:14405:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181591.899459:0:14405:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc0821f4cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789181591.899566:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510100224 00000100:00100000:1.0:1789181591.899571:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510100224 00000100:00100000:1.0:1789181591.899589:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789181591.899595:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bba0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:486954f1-c2e6-402a-b3c8-096af476560c+9:14405:x1876092510100224:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789181591.899905:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bba0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:486954f1-c2e6-402a-b3c8-096af476560c+9:14405:x1876092510100224:12345-0@lo:503:mount.lustre.0 Request processed in 308us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181591.899921:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789181591.900095:0:14405:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1988c3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:14405:1876092510100224:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789181591.900607:0:14441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6e5f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:486954f1-c2e6-402a-b3c8-096af476560c:14441:1876092510100352:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789181591.900648:0:14441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181591.900673:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510100352 00000100:00100000:1.0:1789181591.900677:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510100352 00000100:00100000:1.0:1789181591.900700:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789181591.900706:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bba0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:486954f1-c2e6-402a-b3c8-096af476560c+9:14441:x1876092510100352:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789181591.900931:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bba0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:486954f1-c2e6-402a-b3c8-096af476560c+9:14441:x1876092510100352:12345-0@lo:502:llog_process_th.0 Request processed in 224us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181591.900938:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789181591.900976:0:14441:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc18a5a3d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789181591.900989:0:14441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6e5f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:486954f1-c2e6-402a-b3c8-096af476560c:14441:1876092510100352:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789181591.901030:0:14441:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789181591.901056:0:14441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789181591.901058:0:14441:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1789181591.901063:0:14441:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1789181591.901066:0:14441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789181591.901082:0:14441:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9dc1879d4d40) 00000020:00000080:1.0:1789181591.901101:0:14441:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1789181591.901106:0:14441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1789181591.901170:0:14441:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:1.0:1789181591.901188:0:14441:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8f4f7840b2e42192 00000020:00000080:3.0:1789181591.901690:0:14441:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1789181591.901695:0:14441:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789181591.901700:0:14441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789181591.901701:0:14441:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789181591.901705:0:14441:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789181591.901708:0:14441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789181591.901709:0:14441:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1789181591.901712:0:14441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789181591.901721:0:14441:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9dc189818000) 00000020:00000080:3.0:1789181591.901732:0:14441:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1789181591.901742:0:14441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1789181591.901744:0:14441:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1789181591.901747:0:14441:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1789181591.901752:0:14441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789181591.901813:0:14441:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dc1ba454000 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1789181591.901827:0:14441:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9dc1898199c0) 00000020:00000080:3.0:1789181591.901835:0:14441:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1789181591.901888:0:14441:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1789181591.901894:0:14441:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8f4f7840b2e421a7 00000020:00000080:3.0:1789181591.901995:0:14441:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1789181591.902001:0:14441:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1789181591.902005:0:14441:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x8f4f7840b2e421ae 00080000:01000000:3.0:1789181591.902010:0:14441:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:3.0:1789181591.902013:0:14441:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8f4f7840b2e421b5 00010000:00010000:3.0:1789181591.974466:0:14441:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1789181591.975364:0:14441:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:3.0:1789181591.975725:0:14441:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1789181591.976639:0:14441:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9dc18981cd40) 00000020:00000080:3.0:1789181591.976660:0:14441:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1789181591.976734:0:14441:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:3.0:1789181591.976745:0:14441:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8f4f7840b2e421c3 00000020:00000080:3.0:1789181591.977896:0:14441:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1789181591.983369:0:14441:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x8f4f7840b2e421ca 00000020:00000080:3.0:1789181591.983687:0:14441:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1789181591.983697:0:14441:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789181591.983703:0:14441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789181591.983705:0:14441:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1789181591.983708:0:14441:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789181591.983714:0:14441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789181591.983715:0:14441:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1789181591.983720:0:14441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1789181591.983755:0:14441:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1789181591.983780:0:14441:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789181591.983784:0:14441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789181591.983785:0:14441:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1789181591.983788:0:14441:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789181591.983790:0:14441:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:3.0:1789181591.983791:0:14441:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789181591.983792:0:14441:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789181591.983794:0:14441:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789181591.983796:0:14441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789181591.983798:0:14441:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789181591.983800:0:14441:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789181591.983803:0:14441:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1789181591.983807:0:14441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789181591.983808:0:14441:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1789181591.983811:0:14441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789181591.983816:0:14441:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.132@tcp to nid 0x20000c0a8cc84 (192.168.204.132@tcp) 00000020:01000000:3.0:1789181591.983844:0:14441:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789181591.983847:0:14441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789181591.983911:0:14441:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9dc1a7c0b380) 00000020:00000080:3.0:1789181591.983927:0:14441:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1789181591.983934:0:14441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789181591.983998:0:14441:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1789181591.984004:0:14441:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:3.0:1789181591.984011:0:14441:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8f4f7840b2e421d8 00010000:00080000:3.0:1789181591.984059:0:14441:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dc1c1dc0800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.132@tcp at head 00010000:00010000:3.0:1789181591.984271:0:14441:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:3.0:1789181591.984686:0:14441:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1789181591.984732:0:14441:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789181591.985735:0:14441:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789181591.985804:0:14441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1789181591.985883:0:14441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1789181591.991822:0:14445:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789181591.991829:0:14445:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1789181591.993852:0:14441:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789181591.993871:0:14441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789181591.993912:0:14441:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789181591.993932:0:14441:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8f4f7840b2e421df 00000100:00080000:3.0:1789181591.993943:0:14441:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789181591.993955:0:14441:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9dc1c1dc0800 using connection 192.168.204.132@tcp/0@lo 00000100:00100000:3.0:1789181591.993992:0:14441:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc1988c3480 x1876092510100480/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789181591.994058:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1988c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1876092510100480:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789181591.994109:0:3302:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876092510100480 offset 0 length 520: 4 00000100:00080000:3.0:1789181591.994177:0:14441:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1789181591.994968:0:14441:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789181591.994975:0:14441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789181591.994977:0:14441:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1789181591.994980:0:14441:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789181591.994983:0:14441:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:3.0:1789181591.994984:0:14441:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789181591.994986:0:14441:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789181591.994987:0:14441:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789181591.994990:0:14441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789181591.994991:0:14441:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789181591.994994:0:14441:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789181591.994998:0:14441:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1789181591.995001:0:14441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789181591.995003:0:14441:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1789181591.995006:0:14441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789181591.995009:0:14441:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.132@tcp to nid 0x20000c0a8cc84 (192.168.204.132@tcp) 00000020:01000000:3.0:1789181591.995031:0:14441:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789181591.995033:0:14441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789181591.995047:0:14441:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9dc1a7c08000) 00000020:00000080:3.0:1789181591.995062:0:14441:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1789181591.995067:0:14441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789181591.995134:0:14441:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1789181591.995141:0:14441:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:3.0:1789181591.995152:0:14441:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8f4f7840b2e421ed 00010000:00080000:3.0:1789181591.995182:0:14441:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dc1992d7800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.132@tcp at head 00010000:00010000:3.0:1789181591.995495:0:14441:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:3.0:1789181591.995694:0:14441:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1789181591.995716:0:14441:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789181591.996202:0:14441:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789181591.996268:0:14441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1789181591.999632:0:14441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:2.0:1789181592.005442:0:14447:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789181592.005452:0:14447:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1789181592.008616:0:14441:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789181592.008631:0:14441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789181592.008671:0:14441:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789181592.008693:0:14441:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8f4f7840b2e421f4 00000100:00080000:1.0:1789181592.008703:0:14441:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789181592.008730:0:14441:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9dc1992d7800 using connection 192.168.204.132@tcp/0@lo 00000100:00100000:1.0:1789181592.008769:0:14441:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc1b6e5f100 x1876092510100608/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789181592.008794:0:14441:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1789181592.008878:0:14441:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789181592.008883:0:14441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789181592.008885:0:14441:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1789181592.008888:0:14441:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789181592.008892:0:14441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789181592.008894:0:14441:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789181592.008897:0:14441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789181592.008899:0:14441:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789181592.008901:0:14441:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789181592.008903:0:14441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789181592.008905:0:14441:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789181592.008907:0:14441:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789181592.008910:0:14441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789181592.008912:0:14441:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789181592.008915:0:14441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789181592.008948:0:14441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6e5f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:486954f1-c2e6-402a-b3c8-096af476560c:14441:1876092510100736:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789181592.009030:0:14441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181592.009081:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510100736 00000100:00100000:1.0:1789181592.009088:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510100736 00000100:00100000:1.0:1789181592.009126:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789181592.009134:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bba0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:486954f1-c2e6-402a-b3c8-096af476560c+9:14441:x1876092510100736:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789181592.009408:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bba0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:486954f1-c2e6-402a-b3c8-096af476560c+9:14441:x1876092510100736:12345-0@lo:502:llog_process_th.0 Request processed in 274us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181592.009416:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789181592.009460:0:14441:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc18a5a3d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789181592.009479:0:14441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6e5f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:486954f1-c2e6-402a-b3c8-096af476560c:14441:1876092510100736:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789181592.009512:0:14441:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789181592.009516:0:14441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789181592.009517:0:14441:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789181592.009521:0:14441:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000100:00100000:0.0:1789181592.009837:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6e5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1876092510100608:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789181592.009867:0:3302:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876092510100608 offset 0 length 520: 4 00000020:01000000:3.0:1789181592.009965:0:14405:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:3.0:1789181592.009985:0:14405:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.132@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789181592.010006:0:14405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1e600/0x8f4f7840b2e4217d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e42184 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181592.010016:0:14405:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1e600/0x8f4f7840b2e4217d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e42184 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789181592.010024:0:14405:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9dc1ba454000 from 1 10000000:01000000:3.0:1789181592.010027:0:14405:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789181592.010065:0:14405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1fa00/0x8f4f7840b2e421fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181592.010074:0:14405:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1fa00/0x8f4f7840b2e421fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181592.010083:0:14405:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1fa00/0x8f4f7840b2e421fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181592.010097:0:14405:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1988c0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:14405:1876092510100864:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789181592.010127:0:14405:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181592.010189:0:14405:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc187dfd0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789181592.013173:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510100864 00000100:00100000:3.0:1789181592.013204:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510100864 00000100:00100000:3.0:1789181592.013310:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789181592.014151:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bba0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:486954f1-c2e6-402a-b3c8-096af476560c+9:14405:x1876092510100864:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789181592.014170:0:14417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181592.014192:0:14417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc1bfa1ee00/0x8f4f7840b2e42202 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f4f7840b2e421fb expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181592.014220:0:14417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc1bfa1ee00/0x8f4f7840b2e42202 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f4f7840b2e421fb expref: 10 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181592.014231:0:14417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc1bfa1ee00/0x8f4f7840b2e42202 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e421fb expref: 10 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181592.014240:0:14417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1bfa1ee00, rc 0) 00000100:00100000:3.0:1789181592.014416:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bba0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:486954f1-c2e6-402a-b3c8-096af476560c+10:14405:x1876092510100864:12345-0@lo:101:mount.lustre.0 Request processed in 1097us (4287us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181592.014423:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789181592.017210:0:14405:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1988c0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:14405:1876092510100864:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789181592.017241:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1fa00/0x8f4f7840b2e421fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e42202 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181592.017253:0:14405:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1fa00/0x8f4f7840b2e421fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f4f7840b2e42202 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181592.017845:0:14405:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0833d1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:14405:1876092510100992:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1789181592.017937:0:14405:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181592.017983:0:14405:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1884b5cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789181592.018164:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510100992 00000100:00100000:1.0:1789181592.018174:0:14418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510100992 00000100:00100000:1.0:1789181592.018226:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789181592.018236:0:14418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bbadb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:486954f1-c2e6-402a-b3c8-096af476560c+10:14405:x1876092510100992:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1789181592.018254:0:14418:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1789181592.018261:0:14418:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1789181592.018389:0:14418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bbadb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:486954f1-c2e6-402a-b3c8-096af476560c+10:14405:x1876092510100992:12345-0@lo:256:mount.lustre.0 Request processed in 154us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181592.018397:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789181592.018538:0:14405:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc0833d1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:14405:1876092510100992:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1789181592.019114:0:14405:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789181592.019129:0:14405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1fa00/0x8f4f7840b2e421fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e42202 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181592.019139:0:14405:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1fa00/0x8f4f7840b2e421fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e42202 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789181592.019148:0:14405:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9dc1ba454000 from 1 10000000:01000000:0.0:1789181592.019158:0:14405:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789181592.019187:0:14405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc189891400/0x8f4f7840b2e42209 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181592.019195:0:14405:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.132@tcp lock: ffff9dc189891400/0x8f4f7840b2e42209 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181592.019203:0:14405:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.132@tcp lock: ffff9dc189891400/0x8f4f7840b2e42209 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181592.019219:0:14405:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c01c5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:14405:1876092510101120:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789181592.019255:0:14405:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181592.019293:0:14405:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc199eab0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789181592.019530:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510101120 00000100:00100000:1.0:1789181592.019537:0:14418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510101120 00000100:00100000:1.0:1789181592.019563:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789181592.019570:0:14418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bbadbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:486954f1-c2e6-402a-b3c8-096af476560c+10:14405:x1876092510101120:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789181592.019580:0:14418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181592.019594:0:14418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc18151ae00/0x8f4f7840b2e42210 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f4f7840b2e42209 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181592.019614:0:14418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc18151ae00/0x8f4f7840b2e42210 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f4f7840b2e42209 expref: 11 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181592.019623:0:14418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc18151ae00/0x8f4f7840b2e42210 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e42209 expref: 11 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181592.019631:0:14418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc18151ae00, rc 0) 00000100:00100000:1.0:1789181592.019660:0:14418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bbadbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:486954f1-c2e6-402a-b3c8-096af476560c+11:14405:x1876092510101120:12345-0@lo:101:mount.lustre.0 Request processed in 92us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181592.019673:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789181592.019758:0:14405:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c01c5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:14405:1876092510101120:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789181592.019771:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.132@tcp lock: ffff9dc189891400/0x8f4f7840b2e42209 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e42210 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181592.019779:0:14405:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.132@tcp lock: ffff9dc189891400/0x8f4f7840b2e42209 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f4f7840b2e42210 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181592.019829:0:14405:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c01c5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:14405:1876092510101248:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789181592.019853:0:14405:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181592.019881:0:14405:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc199eab0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789181592.019930:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510101248 00000100:00100000:1.0:1789181592.019934:0:14418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510101248 00000100:00100000:1.0:1789181592.019953:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789181592.019959:0:14418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bbadb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:486954f1-c2e6-402a-b3c8-096af476560c+11:14405:x1876092510101248:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789181592.020509:0:14418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bbadb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:486954f1-c2e6-402a-b3c8-096af476560c+11:14405:x1876092510101248:12345-0@lo:501:mount.lustre.0 Request processed in 547us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181592.020516:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789181592.021504:0:14405:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c01c5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:14405:1876092510101248:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789181592.021551:0:14405:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c01c5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:14405:1876092510101376:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789181592.021611:0:14405:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181592.021644:0:14405:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc199eab0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789181592.021734:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510101376 00000100:00100000:1.0:1789181592.021740:0:14418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510101376 00000100:00100000:1.0:1789181592.021770:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789181592.021778:0:14418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bbada450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:486954f1-c2e6-402a-b3c8-096af476560c+11:14405:x1876092510101376:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789181592.021938:0:14418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bbada450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:486954f1-c2e6-402a-b3c8-096af476560c+11:14405:x1876092510101376:12345-0@lo:503:mount.lustre.0 Request processed in 160us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181592.021946:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789181592.022180:0:14405:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c01c5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:14405:1876092510101376:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789181592.025585:0:14449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0833d0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:486954f1-c2e6-402a-b3c8-096af476560c:14449:1876092510101504:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789181592.025670:0:14449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181592.025713:0:14449:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1884b56c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789181592.025767:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510101504 00000100:00100000:1.0:1789181592.025775:0:14418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510101504 00000100:00100000:1.0:1789181592.025822:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789181592.025831:0:14418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bbad9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:486954f1-c2e6-402a-b3c8-096af476560c+11:14449:x1876092510101504:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789181592.026097:0:14418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bbad9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:486954f1-c2e6-402a-b3c8-096af476560c+11:14449:x1876092510101504:12345-0@lo:502:llog_process_th.0 Request processed in 267us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181592.026106:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789181592.026313:0:14449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc0833d0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:486954f1-c2e6-402a-b3c8-096af476560c:14449:1876092510101504:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789181592.026487:0:14449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789181592.026498:0:14449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789181592.026501:0:14449:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789181592.026508:0:14449:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dc1ba454000 00000020:00000080:3.0:1789181592.026510:0:14449:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789181592.026518:0:14449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789181592.026520:0:14449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789181592.026521:0:14449:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1789181592.026524:0:14449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789181592.026526:0:14449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789181592.026527:0:14449:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789181592.026530:0:14449:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dc1ba454000 00000020:00000080:3.0:1789181592.026539:0:14449:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789181592.026635:0:14449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789181592.026639:0:14449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789181592.026640:0:14449:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789181592.026643:0:14449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789181592.026646:0:14449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789181592.026647:0:14449:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789181592.026651:0:14449:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9dc1ba454000 00000020:00000080:3.0:1789181592.026653:0:14449:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789181592.034919:0:14449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1988c3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:486954f1-c2e6-402a-b3c8-096af476560c:14449:1876092510101632:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789181592.035322:0:14449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181592.035390:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510101632 00000100:00100000:3.0:1789181592.035398:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510101632 00000100:00100000:3.0:1789181592.035444:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789181592.035454:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bbad9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:486954f1-c2e6-402a-b3c8-096af476560c+11:14449:x1876092510101632:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789181592.035899:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bbad9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:486954f1-c2e6-402a-b3c8-096af476560c+11:14449:x1876092510101632:12345-0@lo:502:llog_process_th.0 Request processed in 445us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181592.035908:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789181592.035969:0:14449:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1884f3e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789181592.035992:0:14449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1988c3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:486954f1-c2e6-402a-b3c8-096af476560c:14449:1876092510101632:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789181592.036023:0:14449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789181592.036032:0:14449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789181592.036034:0:14449:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1789181592.036039:0:14449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1789181592.038039:0:14405:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1789181592.038071:0:14405:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789181592.038095:0:14405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc189891400/0x8f4f7840b2e42209 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e42210 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181592.038121:0:14405:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.132@tcp lock: ffff9dc189891400/0x8f4f7840b2e42209 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e42210 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789181592.038177:0:14405:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789181592.038181:0:14405:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9dc1ba454000 10000000:01000000:1.0:1789181592.038184:0:14405:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9dc1ba454000 10000000:01000000:1.0:1789181592.038188:0:14405:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789181592.038194:0:14405:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9dc1ba454000 from 1 10000000:01000000:1.0:1789181592.038197:0:14405:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789181592.038231:0:14405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc18151a600/0x8f4f7840b2e42217 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181592.038240:0:14405:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.132@tcp lock: ffff9dc18151a600/0x8f4f7840b2e42217 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181592.038250:0:14405:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.132@tcp lock: ffff9dc18151a600/0x8f4f7840b2e42217 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181592.038275:0:14405:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6e5f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:14405:1876092510101760:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789181592.038388:0:14405:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181592.038431:0:14405:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1811ca180 going to sleep for 11 seconds 00000100:00100000:1.0:1789181592.040477:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510101760 00000100:00100000:1.0:1789181592.040492:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510101760 00000100:00100000:1.0:1789181592.040557:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789181592.040567:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bbad9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:486954f1-c2e6-402a-b3c8-096af476560c+11:14405:x1876092510101760:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789181592.040582:0:14416:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181592.040597:0:14416:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc18151b600/0x8f4f7840b2e4221e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f4f7840b2e42217 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181592.040643:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc18151b600/0x8f4f7840b2e4221e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f4f7840b2e42217 expref: 12 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181592.040654:0:14416:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc18151b600/0x8f4f7840b2e4221e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e42217 expref: 12 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181592.040663:0:14416:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc18151b600, rc 0) 00000100:00100000:1.0:1789181592.040735:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bbad9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:486954f1-c2e6-402a-b3c8-096af476560c+12:14405:x1876092510101760:12345-0@lo:101:mount.lustre.0 Request processed in 170us (2346us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181592.040742:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789181592.040813:0:14405:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6e5f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:14405:1876092510101760:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789181592.040835:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.132@tcp lock: ffff9dc18151a600/0x8f4f7840b2e42217 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e4221e expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181592.040845:0:14405:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.132@tcp lock: ffff9dc18151a600/0x8f4f7840b2e42217 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f4f7840b2e4221e expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181592.040936:0:14405:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6e5f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:14405:1876092510101888:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789181592.040970:0:14405:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181592.040999:0:14405:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1811ca180 going to sleep for 11 seconds 00000100:00100000:1.0:1789181592.041014:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510101888 00000100:00100000:1.0:1789181592.041018:0:14418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510101888 00000100:00100000:1.0:1789181592.041039:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789181592.041045:0:14418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bbad8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:486954f1-c2e6-402a-b3c8-096af476560c+12:14405:x1876092510101888:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789181592.041299:0:14418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bbad8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:486954f1-c2e6-402a-b3c8-096af476560c+12:14405:x1876092510101888:12345-0@lo:501:mount.lustre.0 Request processed in 252us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181592.041323:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789181592.041387:0:14405:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6e5f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:14405:1876092510101888:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789181592.041416:0:14405:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6e5f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:14405:1876092510102016:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789181592.041453:0:14405:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181592.041473:0:14405:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1ba5e0180 going to sleep for 11 seconds 00000100:00100000:1.0:1789181592.041487:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510102016 00000100:00100000:1.0:1789181592.041491:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510102016 00000100:00100000:1.0:1789181592.041512:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789181592.041518:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bbadac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:486954f1-c2e6-402a-b3c8-096af476560c+12:14405:x1876092510102016:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789181592.041661:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bbadac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:486954f1-c2e6-402a-b3c8-096af476560c+12:14405:x1876092510102016:12345-0@lo:503:mount.lustre.0 Request processed in 143us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181592.041668:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789181592.041707:0:14405:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6e5f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:14405:1876092510102016:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789181592.041919:0:14452:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6e5f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:486954f1-c2e6-402a-b3c8-096af476560c:14452:1876092510102144:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789181592.041950:0:14452:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181592.041968:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510102144 00000100:00100000:1.0:1789181592.041972:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510102144 00000100:00100000:1.0:1789181592.041992:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789181592.041998:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bbad8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:486954f1-c2e6-402a-b3c8-096af476560c+12:14452:x1876092510102144:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789181592.042138:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bbad8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:486954f1-c2e6-402a-b3c8-096af476560c+12:14452:x1876092510102144:12345-0@lo:502:llog_process_th.0 Request processed in 139us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181592.042145:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789181592.042174:0:14452:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1ba5e0c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789181592.042185:0:14452:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6e5f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:486954f1-c2e6-402a-b3c8-096af476560c:14452:1876092510102144:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1789181592.042241:0:14452:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1789181592.042254:0:14452:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9dc1879d3380) 00000020:00000080:1.0:1789181592.042272:0:14452:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:1.0:1789181592.042400:0:14452:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dc1ba454000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1789181592.042404:0:14452:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dc1ba454000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1789181592.042407:0:14452:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dc1ba454000 4 00010000:00080000:1.0:1789181592.042433:0:14452:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dc1878b7000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.132@tcp at head 00010000:00010000:1.0:1789181592.044469:0:14452:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:1.0:1789181592.044712:0:14452:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1789181592.044759:0:14452:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789181592.044773:0:14452:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x8f4f7840b2e4222c 00000100:00080000:1.0:1789181592.044782:0:14452:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789181592.044793:0:14452:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9dc1878b7000 using connection 192.168.204.132@tcp/0@lo 00000100:00100000:1.0:1789181592.044829:0:14452:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc1b6e5f800 x1876092510102272/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789181592.044869:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6e5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876092510102272:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789181592.044945:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181592.044996:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510102272 00000100:00100000:3.0:1789181592.045005:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510102272 00000100:00080000:1.0:1789181592.045008:0:14452:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789181592.045057:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789181592.045065:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6e5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3302:x1876092510102272:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789181592.045129:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6e5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3302:x1876092510102272:12345-0@lo:38:llog_process_th.0 Request processed in 64us (185us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789181592.045543:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789181592.045590:0:3302:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789181592.045599:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9dc1878b7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789181592.045603:0:3302:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789181592.045607:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6e5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876092510102272:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789181592.048182:0:14452:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6e5dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:486954f1-c2e6-402a-b3c8-096af476560c:14452:1876092510102400:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789181592.048268:0:14452:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181592.049433:0:14452:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1ba5e0300 going to sleep for 11 seconds 00000100:00100000:0.0:1789181592.050401:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510102400 00000100:00100000:0.0:1789181592.050412:0:14418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510102400 00000100:00100000:0.0:1789181592.050470:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789181592.050482:0:14418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bbad9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:486954f1-c2e6-402a-b3c8-096af476560c+12:14452:x1876092510102400:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789181592.050804:0:14418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bbad9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:486954f1-c2e6-402a-b3c8-096af476560c+12:14452:x1876092510102400:12345-0@lo:502:llog_process_th.0 Request processed in 325us (2536us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181592.050813:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789181592.051436:0:14452:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6e5dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:486954f1-c2e6-402a-b3c8-096af476560c:14452:1876092510102400:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789181592.051474:0:14452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1789181592.051809:0:14405:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1789181592.051830:0:14405:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789181592.051897:0:14405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc18151a600/0x8f4f7840b2e42217 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e4221e expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181592.051908:0:14405:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.132@tcp lock: ffff9dc18151a600/0x8f4f7840b2e42217 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e4221e expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789181592.051968:0:14405:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789181592.051971:0:14405:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789181592.051972:0:14405:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789181592.051973:0:14405:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789181592.051974:0:14405:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789181592.051976:0:14405:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789181592.051977:0:14405:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789181592.051979:0:14405:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789181592.051981:0:14405:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789181592.051982:0:14405:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789181592.051985:0:14405:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1789181592.051988:0:14405:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789181592.051990:0:14405:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789181592.051991:0:14405:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789181592.051992:0:14405:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789181592.051993:0:14405:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789181592.051994:0:14405:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789181592.051995:0:14405:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789181592.051996:0:14405:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789181592.051997:0:14405:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789181592.051998:0:14405:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789181592.052020:0:14405:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1789181592.052038:0:14405:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6e5fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:14405:1876092510102528:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789181592.052090:0:14405:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181592.052122:0:14405:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1ba5e06c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789181592.052139:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510102528 00000100:00100000:1.0:1789181592.052145:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510102528 00000100:00100000:1.0:1789181592.052180:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789181592.052189:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bbad8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:486954f1-c2e6-402a-b3c8-096af476560c+12:14405:x1876092510102528:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789181592.052222:0:14417:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1789181592.052236:0:14417:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789181592.105944:0:14417:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789181592.105959:0:14417:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1789181592.105973:0:14439:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789181592.105981:0:14439:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789181592.106011:0:14439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dc1c0259c00/0x8f4f7840b2e42233 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181592.106034:0:14439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dc1bfa1ee00/0x8f4f7840b2e42202 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e421fb expref: 12 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181592.106044:0:14439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9dc1c0259c00/0x8f4f7840b2e42233 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181592.106086:0:14439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dc1bfa1ee00/0x8f4f7840b2e42202 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8f4f7840b2e421fb expref: 12 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181592.106101:0:14439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dc1bfa1ee00/0x8f4f7840b2e42202 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8f4f7840b2e421fb expref: 12 pid: 14417 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181592.106117:0:14439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0833d2d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14439:1876092510102656:0@lo:104: 00000100:00100000:2.0:1789181592.106259:0:14439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181592.106346:0:14439:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc083b9e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789181592.107301:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510102656 00000100:00100000:0.0:1789181592.107405:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510102656 00000100:00100000:0.0:1789181592.107451:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789181592.107460:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0833d3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:486954f1-c2e6-402a-b3c8-096af476560c+3:14439:x1876092510102656:12345-0@lo:104: 00010000:00010000:0.0:1789181592.107590:0:14406:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1fa00/0x8f4f7840b2e421fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f4f7840b2e42202 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181592.108311:0:14406:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:1.0:1789181592.108445:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789181592.108454:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1fa00/0x8f4f7840b2e421fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f4f7840b2e42202 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181592.108554:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1bfa1fa00 already unused, calling callback (ffffffffc1b45c20) 10000000:00010000:1.0:1789181592.108559:0:14411:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1fa00/0x8f4f7840b2e421fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8f4f7840b2e42202 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181592.108569:0:14411:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1fa00/0x8f4f7840b2e421fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8f4f7840b2e42202 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789181592.108576:0:14411:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1fa00/0x8f4f7840b2e421fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8f4f7840b2e42202 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789181592.108589:0:14411:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:0.0:1789181592.108701:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0833d3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:486954f1-c2e6-402a-b3c8-096af476560c+3:14439:x1876092510102656:12345-0@lo:104: Request processed in 1240us (2440us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181592.108710:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789181592.108825:0:14439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc0833d2d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14439:1876092510102656:0@lo:104: 00010000:00010000:2.0:1789181592.108848:0:14439:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9dc1c0259c00/0x8f4f7840b2e42233 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181592.108932:0:14411:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1fa00/0x8f4f7840b2e421fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e42202 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181592.108939:0:14411:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789181592.108973:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1fa00/0x8f4f7840b2e421fb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e42202 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181592.108980:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1fa00/0x8f4f7840b2e421fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e42202 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181592.109000:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181592.109001:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181592.109003:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181592.109076:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789181592.109089:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6e5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:486954f1-c2e6-402a-b3c8-096af476560c:3305:1876092510102784:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789181592.109136:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181592.109756:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510102784 00000100:00100000:1.0:1789181592.109764:0:14408:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510102784 00010000:00010000:1.0:1789181592.109798:0:14408:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dc1bfa1ee00/0x8f4f7840b2e42202 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f4f7840b2e421fb expref: 13 pid: 14417 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181592.109865:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789181592.109874:0:14408:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6e5f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:486954f1-c2e6-402a-b3c8-096af476560c+13:3305:x1876092510102784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789181592.109887:0:14408:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789181592.109892:0:14408:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dc1bfa1ee00/0x8f4f7840b2e42202 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f4f7840b2e421fb expref: 13 pid: 14417 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181592.109904:0:14408:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dc1bfa1ee00/0x8f4f7840b2e42202 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8f4f7840b2e421fb expref: 13 pid: 14417 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181592.109919:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc1bfa1ee00/0x8f4f7840b2e42202 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8f4f7840b2e421fb expref: 13 pid: 14417 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181592.109935:0:14408:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9dc1c0259c00/0x8f4f7840b2e42233 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181592.109944:0:14408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc1c0259c00/0x8f4f7840b2e42233 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789181592.109958:0:14408:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003978598s 00010000:00010000:1.0:1789181592.109963:0:14408:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dc1c0259c00/0x8f4f7840b2e42233 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181592.109970:0:14408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dc1c0259c00/0x8f4f7840b2e42233 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181592.109978:0:14408:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dc1c0259c00/0x8f4f7840b2e42233 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181592.109984:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dc1c0259c00/0x8f4f7840b2e42233 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181592.109998:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1c0259c00 already unused, calling callback (ffffffffc152f9b0) 00010000:00010000:1.0:1789181592.110002:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dc1c0259c00/0x8f4f7840b2e42233 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181592.110009:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dc1c0259c00/0x8f4f7840b2e42233 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181592.110038:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dc1c0259c00/0x8f4f7840b2e42233 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181592.110048:0:14408:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789181592.110097:0:14408:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6e5f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:486954f1-c2e6-402a-b3c8-096af476560c+12:3305:x1876092510102784:12345-0@lo:103:ldlm_bl.0 Request processed in 224us (961us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181592.110105:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789181592.110162:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6e5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:486954f1-c2e6-402a-b3c8-096af476560c:3305:1876092510102784:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789181592.110765:0:14439:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9dc1c0259c00/0x8f4f7840b2e42233 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181592.110783:0:14439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dc1c0259c00/0x8f4f7840b2e42233 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181592.110790:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc1c0259c00/0x8f4f7840b2e42233 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181592.117107:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bbad8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:486954f1-c2e6-402a-b3c8-096af476560c+11:14405:x1876092510102528:12345-0@lo:253:mount.lustre.0 Request processed in 64908us (65006us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181592.117134:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789181592.117170:0:14405:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6e5fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:14405:1876092510102528:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789181592.117188:0:14405:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789181592.117193:0:14405:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789181592.117195:0:14405:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789181592.117197:0:14405:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789181592.117198:0:14405:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789181592.117199:0:14405:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789181592.117200:0:14405:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789181592.117201:0:14405:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789181592.117203:0:14405:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789181592.117205:0:14405:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789181592.117206:0:14405:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789181592.117224:0:14405:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1789181592.121265:0:14405:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1789181592.121538:0:14405:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1789181592.121784:0:14405:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1789181592.121916:0:14405:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1789181592.122094:0:14405:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1789181592.122529:0:14405:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1789181592.123466:0:14405:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1789181592.123630:0:14405:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1789181592.123895:0:14405:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1789181592.124130:0:14405:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1789181592.124562:0:14405:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1789181592.124719:0:14405:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:1.0:1789181592.144312:0:14405:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1789181592.144777:0:14405:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1789181592.144924:0:14462:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:1.0:1789181592.144928:0:14462:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:1.0:1789181592.145182:0:14463:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:1.0:1789181592.145253:0:14463:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:2.0:1789181592.146601:0:14405:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1789181592.146710:0:14405:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1789181592.147136:0:14405:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1789181592.147142:0:14405:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1789181592.147257:0:14405:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789181592.149020:0:14405:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1789181592.149976:0:14405:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1789181592.150157:0:14405:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1789181592.150735:0:14463:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789181592.150793:0:14463:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1789181592.150797:0:14463:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00080000:10000000:3.0:1789181592.151582:0:14405:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:3.0:1789181592.156083:0:14405:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1789181592.188907:0:14405:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1789181592.188954:0:14405:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffaf38c1c87988 00100000:10000000:1.0:1789181592.188963:0:14405:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1789181592.189903:0:14405:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789181592.189921:0:14405:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.132@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789181592.189937:0:14405:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1789181592.189968:0:14405:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:3.0:1789181592.766537:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789181593.091986:0:14458:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:2.0:1789181593.279372:0:14420:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789181593.279379:0:14420:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9dc1ba454000 from 6 10000000:01000000:2.0:1789181593.279384:0:14420:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789181593.279429:0:14420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc1c0259e00/0x8f4f7840b2e4223a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181593.279441:0:14420:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.132@tcp lock: ffff9dc1c0259e00/0x8f4f7840b2e4223a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181593.280566:0:14420:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.132@tcp lock: ffff9dc1c0259e00/0x8f4f7840b2e4223a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181593.280595:0:14420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0833d2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:486954f1-c2e6-402a-b3c8-096af476560c:14420:1876092510102912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789181593.280664:0:14420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181593.280707:0:14420:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc188bfd480 going to sleep for 11 seconds 00000100:00100000:0.0:1789181593.281148:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510102912 00000100:00100000:0.0:1789181593.281157:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510102912 00000100:00100000:0.0:1789181593.281212:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789181593.281221:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bbada850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:486954f1-c2e6-402a-b3c8-096af476560c+11:14420:x1876092510102912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789181593.281233:0:14416:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181593.281248:0:14416:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc189890800/0x8f4f7840b2e42241 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f4f7840b2e4223a expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181593.281284:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc189890800/0x8f4f7840b2e42241 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f4f7840b2e4223a expref: 12 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181593.281295:0:14416:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc189890800/0x8f4f7840b2e42241 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e4223a expref: 12 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181593.281305:0:14416:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc189890800, rc 0) 00000100:00100000:0.0:1789181593.281375:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bbada850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:486954f1-c2e6-402a-b3c8-096af476560c+12:14420:x1876092510102912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 155us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181593.281381:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789181593.281949:0:14420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc0833d2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:486954f1-c2e6-402a-b3c8-096af476560c:14420:1876092510102912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789181593.281967:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.132@tcp lock: ffff9dc1c0259e00/0x8f4f7840b2e4223a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e42241 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181593.281978:0:14420:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.132@tcp lock: ffff9dc1c0259e00/0x8f4f7840b2e4223a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f4f7840b2e42241 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181593.282041:0:14420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0833d2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:486954f1-c2e6-402a-b3c8-096af476560c:14420:1876092510103040:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789181593.282079:0:14420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181593.282103:0:14420:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc188bfd480 going to sleep for 11 seconds 00000100:00100000:0.0:1789181593.282155:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510103040 00000100:00100000:0.0:1789181593.282161:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510103040 00000100:00100000:0.0:1789181593.282197:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789181593.282205:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bbada050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:486954f1-c2e6-402a-b3c8-096af476560c+12:14420:x1876092510103040:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789181593.282219:0:14417:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789181593.282236:0:14417:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789181593.282239:0:14417:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1789181593.282359:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bbada050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:486954f1-c2e6-402a-b3c8-096af476560c+12:14420:x1876092510103040:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 155us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181593.282367:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789181593.282557:0:14420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc0833d2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:486954f1-c2e6-402a-b3c8-096af476560c:14420:1876092510103040:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789181593.282600:0:14420:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789181593.282608:0:14420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc1c0259e00/0x8f4f7840b2e4223a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e42241 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181593.282616:0:14420:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.132@tcp lock: ffff9dc1c0259e00/0x8f4f7840b2e4223a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e42241 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181593.792756:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789181594.113383:0:14458:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789181594.814486:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181595.838454:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789181596.259176:0:14706:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg432-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789181596.864565:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789181597.182470:0:42:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789181597.182477:0:42:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789181597.182480:0:42:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789181597.182483:0:42:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789181597.182486:0:42:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789181597.182489:0:42:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789181597.182492:0:42:0:(import.c:65:import_set_state_nolock()) ffff9dc1878b7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789181597.182509:0:42:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9dc1878b7000 using connection 192.168.204.132@tcp/0@lo 00000100:00100000:1.0:1789181597.182544:0:42:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc1b6e5ce00 x1876092510103296/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789181597.182597:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789181597.182611:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6e5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:486954f1-c2e6-402a-b3c8-096af476560c:3304:1876092510103168:0@lo:400:kworker.0 00000100:00100000:1.0:1789181597.182683:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181597.182743:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6e5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876092510103296:0@lo:38:kworker.0 00000100:00100000:1.0:1789181597.182770:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181597.182802:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510103168 00000100:00100000:1.0:1789181597.182810:0:14418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510103168 00000100:00100000:1.0:1789181597.182849:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789181597.182858:0:14418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bbad8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:486954f1-c2e6-402a-b3c8-096af476560c+12:3304:x1876092510103168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181597.182905:0:14418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bbad8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:486954f1-c2e6-402a-b3c8-096af476560c+12:3304:x1876092510103168:12345-0@lo:400:kworker.0 Request processed in 48us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181597.182912:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789181597.182955:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510103296 00000100:00100000:1.0:1789181597.182958:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510103296 00000100:00100000:1.0:1789181597.182978:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789181597.182982:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6e5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3302:x1876092510103296:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1789181597.183005:0:14425:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 489 last 0 00000020:00000080:1.0:1789181597.183040:0:14425:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x8f4f7840b2e42248 00000004:00100000:1.0:1789181597.183053:0:14425:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789181597.183163:0:14425:0:(import.c:65:import_set_state_nolock()) ffff9dc1878b6000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789181597.183217:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6e5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876092510103296:12345-0@lo:38:kworker.0 Request processed in 233us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181597.183223:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789181597.183268:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9dc1b6e5ce00 x1876092510103296/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789181607 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789181597.183289:0:3302:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1789181597.183296:0:3302:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1789181597.183300:0:3302:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789181597.183302:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9dc1878b7000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789181597.183307:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6e5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876092510103296:0@lo:38:kworker.0 00000100:00100000:1.0:1789181597.183356:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6e5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:486954f1-c2e6-402a-b3c8-096af476560c:3304:1876092510103168:0@lo:400:kworker.0 00010000:00010000:0.0:1789181597.886515:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181598.912718:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789181599.439321:0:14856:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc4bfda570 20000000:00000080:2.0:1789181599.439428:0:14856:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9dc1c1474000 uarg=0000000000000000 20000000:01000000:2.0:1789181599.439460:0:14856:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1789181599.439466:0:14856:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1789181599.439470:0:14856:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1789181599.441316:0:14857:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:2.0:1789181599.441796:0:14856:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1789181599.450915:0:14856:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789181599.451105:0:14856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dc1bfa1ee00/0x8f4f7840b2e4224f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181599.451126:0:14856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dc18151ae00/0x8f4f7840b2e42210 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e42209 expref: 11 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181599.451135:0:14856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9dc1bfa1ee00/0x8f4f7840b2e4224f lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181599.451249:0:14856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dc18151ae00/0x8f4f7840b2e42210 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8f4f7840b2e42209 expref: 11 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181599.451266:0:14856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dc18151ae00/0x8f4f7840b2e42210 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8f4f7840b2e42209 expref: 11 pid: 14418 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181599.451280:0:14856:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1988c3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14856:1876092510103424:0@lo:104: 00000100:00100000:3.0:1789181599.451784:0:14856:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181599.451837:0:14856:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1879cbe40 going to sleep for 11 seconds 00000100:00100000:1.0:1789181599.451899:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510103424 00000100:00100000:1.0:1789181599.451907:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510103424 00000100:00100000:1.0:1789181599.452190:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789181599.452200:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1988c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:486954f1-c2e6-402a-b3c8-096af476560c+3:14856:x1876092510103424:12345-0@lo:104: 00010000:00010000:1.0:1789181599.452214:0:14406:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.132@tcp lock: ffff9dc189891400/0x8f4f7840b2e42209 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f4f7840b2e42210 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181599.452279:0:14406:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789181599.452285:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1988c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:486954f1-c2e6-402a-b3c8-096af476560c+3:14856:x1876092510103424:12345-0@lo:104: Request processed in 87us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181599.452291:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1789181599.452351:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789181599.452358:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.132@tcp lock: ffff9dc189891400/0x8f4f7840b2e42209 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f4f7840b2e42210 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181599.452366:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc189891400 already unused, calling callback (ffffffffc1b45c20) 10000000:00010000:2.0:1789181599.452370:0:14411:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.132@tcp lock: ffff9dc189891400/0x8f4f7840b2e42209 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8f4f7840b2e42210 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181599.452379:0:14411:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.132@tcp lock: ffff9dc189891400/0x8f4f7840b2e42209 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8f4f7840b2e42210 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789181599.452387:0:14411:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.132@tcp lock: ffff9dc189891400/0x8f4f7840b2e42209 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8f4f7840b2e42210 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789181599.452393:0:14411:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789181599.452421:0:14411:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.132@tcp lock: ffff9dc189891400/0x8f4f7840b2e42209 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e42210 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181599.452427:0:14411:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789181599.452444:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.132@tcp lock: ffff9dc189891400/0x8f4f7840b2e42209 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e42210 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181599.452452:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.132@tcp lock: ffff9dc189891400/0x8f4f7840b2e42209 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e42210 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181599.452482:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181599.452483:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181599.452485:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181599.452502:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0833d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:486954f1-c2e6-402a-b3c8-096af476560c:3304:1876092510103552:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789181599.452541:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181599.452587:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510103552 00000100:00100000:2.0:1789181599.452590:0:14409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510103552 00010000:00010000:2.0:1789181599.452607:0:14409:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dc18151ae00/0x8f4f7840b2e42210 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f4f7840b2e42209 expref: 12 pid: 14418 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181599.452627:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789181599.452632:0:14409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0833d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:486954f1-c2e6-402a-b3c8-096af476560c+12:3304:x1876092510103552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789181599.452642:0:14409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789181599.452647:0:14409:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dc18151ae00/0x8f4f7840b2e42210 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f4f7840b2e42209 expref: 12 pid: 14418 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181599.452657:0:14409:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dc18151ae00/0x8f4f7840b2e42210 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8f4f7840b2e42209 expref: 12 pid: 14418 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181599.452672:0:14409:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9dc1bfa1ee00/0x8f4f7840b2e4224f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181599.452680:0:14409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc1bfa1ee00/0x8f4f7840b2e4224f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181599.452693:0:14409:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dc1bfa1ee00/0x8f4f7840b2e4224f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181599.452711:0:14409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dc1bfa1ee00/0x8f4f7840b2e4224f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181599.452724:0:14409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dc1bfa1ee00/0x8f4f7840b2e4224f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181599.452730:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dc1bfa1ee00/0x8f4f7840b2e4224f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181599.452735:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1bfa1ee00 already unused, calling callback (ffffffffc152f9b0) 00010000:00010000:2.0:1789181599.452740:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dc1bfa1ee00/0x8f4f7840b2e4224f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181599.452747:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dc1bfa1ee00/0x8f4f7840b2e4224f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181599.452755:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dc1bfa1ee00/0x8f4f7840b2e4224f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181599.452764:0:14409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789181599.452788:0:14409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0833d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:486954f1-c2e6-402a-b3c8-096af476560c+12:3304:x1876092510103552:12345-0@lo:103:ldlm_bl.0 Request processed in 156us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181599.452794:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789181599.452825:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc0833d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:486954f1-c2e6-402a-b3c8-096af476560c:3304:1876092510103552:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789181599.453150:0:14856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc18151ae00/0x8f4f7840b2e42210 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8f4f7840b2e42209 expref: 11 pid: 14418 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181599.453162:0:14856:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1988c3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14856:1876092510103424:0@lo:104: 00010000:00010000:0.0:1789181599.453186:0:14856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9dc1bfa1ee00/0x8f4f7840b2e4224f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181599.453194:0:14856:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9dc1bfa1ee00/0x8f4f7840b2e4224f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181599.453201:0:14856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dc1bfa1ee00/0x8f4f7840b2e4224f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181599.453206:0:14856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc1bfa1ee00/0x8f4f7840b2e4224f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181599.934522:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181600.958520:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789181601.284276:0:14420:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789181601.284284:0:14420:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9dc1ba454000 from 10 10000000:01000000:2.0:1789181601.284289:0:14420:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789181601.284350:0:14420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc1c0259000/0x8f4f7840b2e42256 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181601.284362:0:14420:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.132@tcp lock: ffff9dc1c0259000/0x8f4f7840b2e42256 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181601.284389:0:14420:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.132@tcp lock: ffff9dc1c0259000/0x8f4f7840b2e42256 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181601.284414:0:14420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0833d2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:486954f1-c2e6-402a-b3c8-096af476560c:14420:1876092510103680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789181601.285255:0:3302:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789181591/real 1789181591] req@ffff9dc1988c3480 x1876092510100480/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789181601 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181601.285284:0:3302:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9dc1988c3480 x1876092510100480/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789181601 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789181601.285303:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9dc1c1dc0800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789181601.285356:0:3302:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789181601.285360:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1988c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1876092510100480:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1789181601.285437:0:42:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789181601.285441:0:42:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1789181601.285443:0:42:0:(import.c:65:import_set_state_nolock()) ffff9dc1c1dc0800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789181601.285447:0:42:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 484 00000100:00080000:1.0:1789181601.285451:0:42:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789181601.285461:0:42:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9dc1c1dc0800 using connection 192.168.204.132@tcp/0@lo 00000100:00100000:1.0:1789181601.285480:0:42:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc1b6e5ce00 x1876092510103936/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789181601.285503:0:42:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789181601.285506:0:42:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789181601.285531:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6e5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:486954f1-c2e6-402a-b3c8-096af476560c:3305:1876092510103808:0@lo:400:kworker.0 00000100:00100000:1.0:1789181601.285594:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181601.285637:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789181601.285644:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6e5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876092510104064:0@lo:400:kworker.0 00000100:00100000:1.0:1789181601.285924:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181601.285964:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510103808 00000100:00100000:1.0:1789181601.285972:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510103808 00000100:00100000:1.0:1789181601.286014:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789181601.286024:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bbadb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:486954f1-c2e6-402a-b3c8-096af476560c+11:3305:x1876092510103808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181601.286070:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bbadb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:486954f1-c2e6-402a-b3c8-096af476560c+11:3305:x1876092510103808:12345-0@lo:400:kworker.0 Request processed in 49us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181601.286077:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789181601.286133:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6e5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1876092510103936:0@lo:8:kworker.0 00000100:00100000:2.0:1789181601.286256:0:14420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181601.286278:0:14420:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1ba9f5240 going to sleep for 11 seconds 00000400:00000100:1.0:1789181601.286582:0:3302:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876092510103936 offset 0 length 520: 4 00000100:00100000:1.0:1789181601.286612:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510103680 00000100:00100000:1.0:1789181601.286616:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510103680 00000100:00100000:1.0:1789181601.286638:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789181601.286644:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bbadc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:486954f1-c2e6-402a-b3c8-096af476560c+11:14420:x1876092510103680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789181601.286653:0:14417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181601.288851:0:14417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc18151a800/0x8f4f7840b2e4225d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f4f7840b2e42256 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181601.288889:0:14417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc18151a800/0x8f4f7840b2e4225d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f4f7840b2e42256 expref: 12 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181601.288902:0:14417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc18151a800/0x8f4f7840b2e4225d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e42256 expref: 12 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181601.288911:0:14417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc18151a800, rc 0) 00000100:00100000:1.0:1789181601.288992:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bbadc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:486954f1-c2e6-402a-b3c8-096af476560c+12:14420:x1876092510103680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2347us (2735us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181601.289002:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789181601.289080:0:14420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc0833d2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:486954f1-c2e6-402a-b3c8-096af476560c:14420:1876092510103680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789181601.289099:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.132@tcp lock: ffff9dc1c0259000/0x8f4f7840b2e42256 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e4225d expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181601.289120:0:14420:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.132@tcp lock: ffff9dc1c0259000/0x8f4f7840b2e42256 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f4f7840b2e4225d expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181601.289203:0:14420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6e5d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:486954f1-c2e6-402a-b3c8-096af476560c:14420:1876092510104192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789181601.289250:0:14420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181601.289270:0:14420:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1bfb33840 going to sleep for 11 seconds 00000100:00100000:1.0:1789181601.289290:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510104192 00000100:00100000:1.0:1789181601.289296:0:14418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510104192 00000100:00100000:1.0:1789181601.289326:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789181601.289352:0:14418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bbadf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:486954f1-c2e6-402a-b3c8-096af476560c+12:14420:x1876092510104192:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789181601.289655:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510104064 00000100:00100000:0.0:1789181601.289673:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510104064 00000100:00100000:0.0:1789181601.289705:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789181601.289712:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6e5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876092510104064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181601.289753:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6e5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876092510104064:12345-0@lo:400:kworker.0 Request processed in 42us (3830us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181601.289759:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789181601.289826:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9dc1b6e5dc00 x1876092510104064/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181617 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789181601.289838:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6e5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876092510104064:0@lo:400:kworker.0 00000100:00100000:0.0:1789181601.289858:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6e5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:486954f1-c2e6-402a-b3c8-096af476560c:3305:1876092510103808:0@lo:400:kworker.0 00000100:00100000:0.0:1789181601.295517:0:14418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bbadf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:486954f1-c2e6-402a-b3c8-096af476560c+12:14420:x1876092510104192:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 6156us (6255us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181601.295529:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789181601.298161:0:14420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6e5d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:486954f1-c2e6-402a-b3c8-096af476560c:14420:1876092510104192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789181601.298224:0:14420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6e5d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:486954f1-c2e6-402a-b3c8-096af476560c:14420:1876092510104320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789181601.298294:0:14420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181601.298321:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510104320 00000100:00100000:1.0:1789181601.298326:0:14420:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1bfb33840 going to sleep for 11 seconds 00000100:00100000:0.0:1789181601.298342:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510104320 00000100:00100000:0.0:1789181601.298395:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789181601.298404:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bbadf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:486954f1-c2e6-402a-b3c8-096af476560c+12:14420:x1876092510104320:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789181601.299619:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bbadf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:486954f1-c2e6-402a-b3c8-096af476560c+12:14420:x1876092510104320:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1212us (1321us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181601.299629:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789181601.302302:0:14420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6e5d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:486954f1-c2e6-402a-b3c8-096af476560c:14420:1876092510104320:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789181601.304716:0:14920:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1789181601.304977:0:14420:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1789181601.305002:0:14420:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789181601.305028:0:14420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc1c0259000/0x8f4f7840b2e42256 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e4225d expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181601.305040:0:14420:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.132@tcp lock: ffff9dc1c0259000/0x8f4f7840b2e42256 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e4225d expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181601.985927:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181602.305652:0:3302:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789181592/real 1789181592] req@ffff9dc1b6e5f100 x1876092510100608/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789181602 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181602.305682:0:3302:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9dc1b6e5f100 x1876092510100608/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789181602 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789181602.305699:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9dc1992d7800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789181602.305713:0:3302:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789181602.305716:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6e5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1876092510100608:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1789181602.305780:0:41:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789181602.305783:0:41:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789181602.305786:0:41:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789181602.305789:0:41:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789181602.305792:0:41:0:(import.c:65:import_set_state_nolock()) ffff9dc1992d7800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789181602.305796:0:41:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 484 00000100:00080000:2.0:1789181602.305801:0:41:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789181602.305810:0:41:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9dc1992d7800 using connection 192.168.204.132@tcp/0@lo 00000100:00100000:2.0:1789181602.305827:0:41:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc0833d0700 x1876092510104576/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789181602.305878:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0833d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:486954f1-c2e6-402a-b3c8-096af476560c:3303:1876092510104448:0@lo:400:kworker.0 00000100:00100000:2.0:1789181602.305942:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181602.305989:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789181602.305995:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0833d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876092510104704:0@lo:400:kworker.0 00000100:00100000:2.0:1789181602.306024:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181602.306055:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510104448 00000100:00100000:2.0:1789181602.306062:0:14418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510104448 00000100:00100000:2.0:1789181602.306118:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789181602.306138:0:14418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bbadfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:486954f1-c2e6-402a-b3c8-096af476560c+12:3303:x1876092510104448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181602.306186:0:14418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bbadfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:486954f1-c2e6-402a-b3c8-096af476560c+12:3303:x1876092510104448:12345-0@lo:400:kworker.0 Request processed in 49us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181602.306192:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789181602.306235:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510104704 00000100:00100000:2.0:1789181602.306239:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510104704 00000100:00100000:2.0:1789181602.306266:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789181602.306272:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0833d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876092510104704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181602.306318:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0833d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876092510104704:12345-0@lo:400:kworker.0 Request processed in 46us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181602.306324:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789181602.306370:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0833d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1876092510104576:0@lo:8:kworker.0 00000400:00000100:2.0:1789181602.306393:0:3302:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876092510104576 offset 0 length 520: 4 00010000:00080000:2.0:1789181602.307069:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9dc0833d2d80 x1876092510104704/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181618 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181602.307094:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc0833d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876092510104704:0@lo:400:kworker.0 00000100:00100000:2.0:1789181602.307250:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc0833d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:486954f1-c2e6-402a-b3c8-096af476560c:3303:1876092510104448:0@lo:400:kworker.0 00010000:00010000:2.0:1789181603.014558:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181604.034372:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789181604.353655:0:14458:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:1.0:1789181604.974170:0:15105:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789181604.974175:0:15105:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1789181604.974304:0:15105:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9dc1a68c7800 00000020:01000004:1.0:1789181604.974319:0:15105:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1789181604.974357:0:15105:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1789181604.974371:0:15105:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9dc1879d0000) 00000020:00000080:1.0:1789181604.974387:0:15105:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1789181605.033869:0:15105:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1789181605.034652:0:15105:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1789181605.040747:0:15105:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1789181605.042745:0:15105:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1789181605.043000:0:15105:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1789181605.044825:0:15105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 345: rc = 0 00100000:10000000:3.0:1789181605.050099:0:15105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 345: rc = 0 00010000:00010000:1.0:1789181605.056088:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1789181605.058843:0:15105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 345: rc = 0 00100000:10000000:2.0:1789181605.061565:0:15105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 616: rc = 0 00100000:10000000:2.0:1789181605.061840:0:15105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 616: rc = 0 00100000:10000000:2.0:1789181605.065373:0:15105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 616: rc = 0 00100000:10000000:2.0:1789181605.065753:0:15105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 616: rc = 0 00100000:10000000:2.0:1789181605.066063:0:15105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 616: rc = 0 00100000:10000000:2.0:1789181605.067981:0:15105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 616: rc = 0 00000020:00000080:2.0:1789181605.068810:0:15105:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1789181605.068821:0:15105:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789181605.068830:0:15105:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x8f4f7840b2e4226b 00000020:01000004:2.0:1789181605.068838:0:15105:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1789181605.068858:0:15105:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.132@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789181605.068861:0:15105:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.132@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789181605.068867:0:15105:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1789181605.068871:0:15105:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1789181605.068880:0:15105:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9dc1babc99c0) 00000020:00000080:2.0:1789181605.068891:0:15105:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:2.0:1789181605.072095:0:15105:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789181605.073691:0:15105:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1789181605.073701:0:15105:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1789181605.074002:0:15105:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1789181605.074008:0:15105:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1789181605.082506:0:15105:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1789181605.082521:0:15105:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1789181605.105776:0:15105:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789181605.108188:0:15105:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1789181605.108201:0:15105:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1789181605.111464:0:15105:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1789181605.111478:0:15105:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1789181605.177990:0:15105:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789181605.178487:0:15105:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789181605.178495:0:15105:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1789181605.181939:0:15105:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789181605.181957:0:15105:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1789181605.182827:0:15105:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789181605.182842:0:15105:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1789181605.197320:0:15105:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789181605.198931:0:15105:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1789181605.198942:0:15105:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1789181605.203498:0:15105:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1789181605.203513:0:15105:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1789181605.287975:0:15105:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789181605.288187:0:15105:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1789181605.288194:0:15105:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1789181605.307923:0:15105:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1789181605.307939:0:15105:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1789181605.308912:0:15105:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1789181605.308936:0:15105:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1789181605.308947:0:15105:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.132@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1789181605.361946:0:15105:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.132@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789181605.361989:0:15105:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.132@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1789181605.361994:0:15105:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789181605.361996:0:15105:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789181605.361997:0:15105:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789181605.361998:0:15105:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789181605.361999:0:15105:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789181605.362000:0:15105:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789181605.362002:0:15105:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789181605.362003:0:15105:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789181605.362005:0:15105:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789181605.362009:0:15105:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1789181605.362011:0:15105:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789181605.362012:0:15105:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789181605.362014:0:15105:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789181605.362014:0:15105:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789181605.362015:0:15105:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789181605.362016:0:15105:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789181605.362017:0:15105:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789181605.362018:0:15105:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789181605.362019:0:15105:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789181605.362061:0:15105:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1789181605.362082:0:15105:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1988c2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:15105:1876092510104832:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789181605.362151:0:15105:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181605.362198:0:15105:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1879cb6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789181605.362405:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510104832 00000100:00100000:0.0:1789181605.362413:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510104832 00000100:00100000:0.0:1789181605.362473:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789181605.362483:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bbadf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:486954f1-c2e6-402a-b3c8-096af476560c+12:15105:x1876092510104832:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789181605.362512:0:14416:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1789181605.362515:0:14416:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1789181605.362518:0:14416:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1789181605.378772:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bbadf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:486954f1-c2e6-402a-b3c8-096af476560c+12:15105:x1876092510104832:12345-0@lo:253:mount.lustre.0 Request processed in 16283us (16612us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181605.378787:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789181605.378986:0:15105:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1988c2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:15105:1876092510104832:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789181605.379000:0:15105:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1789181605.379004:0:15105:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789181605.379005:0:15105:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789181605.379007:0:15105:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789181605.379008:0:15105:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789181605.379009:0:15105:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789181605.379010:0:15105:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789181605.379012:0:15105:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789181605.379014:0:15105:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789181605.379037:0:15105:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789181605.379070:0:15105:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9dc1a68c7800 from lustre-OST0000 10000000:01000000:3.0:1789181605.379093:0:15105:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1789181605.379096:0:15105:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789181605.379103:0:15105:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9dc18981b380 local copy 00010000:00010000:3.0:1789181605.379112:0:15105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1f000/0x8f4f7840b2e42161 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e42168 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181605.379379:0:15105:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1988c2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:15105:1876092510104960:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789181605.379415:0:15105:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181605.379447:0:15105:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1879cba80 going to sleep for 11 seconds 00000100:00100000:1.0:1789181605.379735:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510104960 00000100:00100000:1.0:1789181605.379742:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510104960 00000100:00100000:1.0:1789181605.379782:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789181605.379797:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bbade450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:486954f1-c2e6-402a-b3c8-096af476560c+12:15105:x1876092510104960:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789181605.380137:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bbade450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:486954f1-c2e6-402a-b3c8-096af476560c+12:15105:x1876092510104960:12345-0@lo:501:mount.lustre.0 Request processed in 341us (721us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789181605.380144:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789181605.380239:0:15105:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1988c2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:15105:1876092510104960:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789181605.380254:0:15105:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.132@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789181605.380434:0:15105:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.132@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789181605.380442:0:15105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1f000/0x8f4f7840b2e42161 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e42168 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181605.380451:0:15105:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1f000/0x8f4f7840b2e42161 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e42168 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789181605.380473:0:15105:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9dc1a68c7800 10000000:01000000:3.0:1789181605.380478:0:15105:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789181605.380483:0:15105:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9dc18981b380 10000000:01000000:3.0:1789181605.380485:0:15105:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1789181605.380488:0:15105:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9dc18981b380 from 1 10000000:01000000:3.0:1789181605.380491:0:15105:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789181605.380516:0:15105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1e000/0x8f4f7840b2e42279 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181605.380525:0:15105:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1e000/0x8f4f7840b2e42279 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181605.380541:0:15105:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1e000/0x8f4f7840b2e42279 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181605.380556:0:15105:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1988c2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:15105:1876092510105088:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789181605.380585:0:15105:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181605.380605:0:15105:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1879cba80 going to sleep for 11 seconds 00000100:00100000:1.0:1789181605.380721:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510105088 00000100:00100000:1.0:1789181605.380725:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510105088 00000100:00100000:1.0:1789181605.380987:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789181605.380995:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bbadd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:486954f1-c2e6-402a-b3c8-096af476560c+12:15105:x1876092510105088:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789181605.381005:0:14416:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181605.381018:0:14416:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc18151aa00/0x8f4f7840b2e42280 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f4f7840b2e42279 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181605.381051:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc18151aa00/0x8f4f7840b2e42280 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f4f7840b2e42279 expref: 13 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181605.381062:0:14416:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc18151aa00/0x8f4f7840b2e42280 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e42279 expref: 13 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181605.381071:0:14416:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc18151aa00, rc 0) 00000100:00100000:1.0:1789181605.381114:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bbadd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:486954f1-c2e6-402a-b3c8-096af476560c+13:15105:x1876092510105088:12345-0@lo:101:mount.lustre.0 Request processed in 120us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181605.381120:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789181605.383785:0:15105:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1988c2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:15105:1876092510105088:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789181605.383815:0:15105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1e000/0x8f4f7840b2e42279 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e42280 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181605.383828:0:15105:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1e000/0x8f4f7840b2e42279 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f4f7840b2e42280 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789181605.383862:0:15105:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.132@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789181605.383883:0:15105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1e000/0x8f4f7840b2e42279 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e42280 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181605.383892:0:15105:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1e000/0x8f4f7840b2e42279 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e42280 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789181605.383900:0:15105:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1789181605.383908:0:15105:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789181605.383916:0:15105:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1789181605.383918:0:15105:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789181605.383952:0:15105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc189891200/0x8f4f7840b2e42287 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181605.383960:0:15105:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.132@tcp lock: ffff9dc189891200/0x8f4f7840b2e42287 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181605.383969:0:15105:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.132@tcp lock: ffff9dc189891200/0x8f4f7840b2e42287 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181605.383990:0:15105:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c01c5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:15105:1876092510105216:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789181605.384066:0:15105:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181605.384493:0:15105:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1906609c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789181605.384562:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510105216 00000100:00100000:2.0:1789181605.384569:0:14418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510105216 00000100:00100000:2.0:1789181605.384738:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789181605.384747:0:14418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bbadd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:486954f1-c2e6-402a-b3c8-096af476560c+13:15105:x1876092510105216:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789181605.384762:0:14418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181605.384774:0:14418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc1c0258200/0x8f4f7840b2e4228e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f4f7840b2e42287 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181605.384796:0:14418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc1c0258200/0x8f4f7840b2e4228e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f4f7840b2e42287 expref: 14 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181605.384806:0:14418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc1c0258200/0x8f4f7840b2e4228e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e42287 expref: 14 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181605.384814:0:14418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1c0258200, rc 0) 00000100:00100000:2.0:1789181605.385125:0:14418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bbadd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:486954f1-c2e6-402a-b3c8-096af476560c+14:15105:x1876092510105216:12345-0@lo:101:mount.lustre.0 Request processed in 377us (1057us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181605.385131:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789181605.385425:0:15105:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c01c5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:15105:1876092510105216:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789181605.385441:0:15105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.132@tcp lock: ffff9dc189891200/0x8f4f7840b2e42287 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e4228e expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181605.385451:0:15105:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.132@tcp lock: ffff9dc189891200/0x8f4f7840b2e42287 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f4f7840b2e4228e expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789181605.387634:0:15105:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1789181605.389307:0:15105:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789181605.389649:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1789181605.389691:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1789181605.389725:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1789181605.389785:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1789181605.389825:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1789181605.389879:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1789181605.389937:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1789181605.389944:0:15105:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1789181605.390220:0:15105:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6e5d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:15105:1876092510105344:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789181605.390287:0:15105:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181605.390363:0:15105:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc18849ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1789181605.390503:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510105344 00000100:00100000:2.0:1789181605.390512:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510105344 00000100:00100000:2.0:1789181605.390561:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789181605.390570:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bbadd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:486954f1-c2e6-402a-b3c8-096af476560c+14:15105:x1876092510105344:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789181605.390925:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bbadd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:486954f1-c2e6-402a-b3c8-096af476560c+14:15105:x1876092510105344:12345-0@lo:501:mount.lustre.0 Request processed in 356us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181605.390933:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789181605.391051:0:15105:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6e5d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:15105:1876092510105344:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789181605.391161:0:15105:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6e5d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:15105:1876092510105472:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789181605.391203:0:15105:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181605.391242:0:15105:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc18849ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1789181605.391409:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510105472 00000100:00100000:2.0:1789181605.391414:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510105472 00000100:00100000:2.0:1789181605.391477:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789181605.391492:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bbadcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:486954f1-c2e6-402a-b3c8-096af476560c+14:15105:x1876092510105472:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789181605.391794:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bbadcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:486954f1-c2e6-402a-b3c8-096af476560c+14:15105:x1876092510105472:12345-0@lo:503:mount.lustre.0 Request processed in 302us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181605.391802:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789181605.391964:0:15105:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6e5d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:15105:1876092510105472:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789181605.393016:0:15105:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789181605.393288:0:15105:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6e5d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:15105:1876092510105600:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789181605.393475:0:15105:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181605.393566:0:15105:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1c10b2240 going to sleep for 11 seconds 00000100:00100000:0.0:1789181605.393671:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510105600 00000100:00100000:0.0:1789181605.393678:0:14418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510105600 00000100:00100000:0.0:1789181605.393753:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789181605.393763:0:14418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bbadec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:486954f1-c2e6-402a-b3c8-096af476560c+14:15105:x1876092510105600:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789181605.394265:0:14418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bbadec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:486954f1-c2e6-402a-b3c8-096af476560c+14:15105:x1876092510105600:12345-0@lo:502:mount.lustre.0 Request processed in 502us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181605.394275:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789181605.394529:0:15105:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6e5d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:15105:1876092510105600:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789181605.394811:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1789181605.394862:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1789181605.394889:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1789181605.394943:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1789181605.394975:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1789181605.395003:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1789181605.396517:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1789181605.396582:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1789181605.396617:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:0.0:1789181605.396665:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:0.0:1789181605.396703:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:0.0:1789181605.396753:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:0.0:1789181605.396815:0:15105:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c01c5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:15105:1876092510105728:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789181605.396890:0:15105:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181605.396937:0:15105:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1906600c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789181605.397003:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510105728 00000100:00100000:2.0:1789181605.397010:0:14418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510105728 00000100:00100000:2.0:1789181605.397074:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789181605.397083:0:14418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bbadc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:486954f1-c2e6-402a-b3c8-096af476560c+14:15105:x1876092510105728:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789181605.397289:0:14418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bbadc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:486954f1-c2e6-402a-b3c8-096af476560c+14:15105:x1876092510105728:12345-0@lo:502:mount.lustre.0 Request processed in 207us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181605.397297:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789181605.397769:0:15105:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c01c5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:15105:1876092510105728:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789181605.397852:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:0.0:1789181605.397864:0:15105:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:3.0:1789181605.401594:0:15120:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789181605.401606:0:15120:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1789181605.401613:0:15120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789181605.401616:0:15120:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1789181605.401622:0:15120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789181605.401638:0:15120:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9dc1a7c099c0) 00000020:00000080:3.0:1789181605.401659:0:15120:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789181605.401666:0:15120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789181605.401740:0:15120:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dc1a68c7800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1789181605.401748:0:15120:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789181605.401754:0:15120:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x8f4f7840b2e4229c 00010000:00010000:3.0:1789181605.418069:0:15120:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:3.0:1789181605.418541:0:15120:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:3.0:1789181605.428479:0:15120:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1789181605.431603:0:15120:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1789181605.431623:0:15120:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789181605.431629:0:15120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789181605.431631:0:15120:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1789181605.431634:0:15120:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789181605.431637:0:15120:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1789181605.431638:0:15120:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789181605.431640:0:15120:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789181605.431641:0:15120:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789181605.431643:0:15120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789181605.431644:0:15120:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789181605.431646:0:15120:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789181605.431649:0:15120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789181605.431651:0:15120:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789181605.431661:0:15120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789181605.431663:0:15120:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789181605.431665:0:15120:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789181605.431667:0:15120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789181605.431669:0:15120:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789181605.431671:0:15120:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789181605.431673:0:15120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789181605.431675:0:15120:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789181605.431677:0:15120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1789181605.431733:0:15120:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789181605.431736:0:15120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789181605.431737:0:15120:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789181605.431740:0:15120:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1789181605.434441:0:15105:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1789181605.434480:0:15105:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.132@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789181605.434499:0:15105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc189891200/0x8f4f7840b2e42287 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e4228e expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181605.434515:0:15105:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.132@tcp lock: ffff9dc189891200/0x8f4f7840b2e42287 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e4228e expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789181605.434525:0:15105:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9dc1a68c7800 from 1 10000000:01000000:1.0:1789181605.434528:0:15105:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789181605.434570:0:15105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc18151be00/0x8f4f7840b2e422a3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181605.434578:0:15105:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.132@tcp lock: ffff9dc18151be00/0x8f4f7840b2e422a3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181605.434589:0:15105:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.132@tcp lock: ffff9dc18151be00/0x8f4f7840b2e422a3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181605.434615:0:15105:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6e5e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:15105:1876092510105856:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789181605.434696:0:15105:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181605.434737:0:15105:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1c10b2600 going to sleep for 11 seconds 00000100:00100000:2.0:1789181605.435893:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510105856 00000100:00100000:2.0:1789181605.435904:0:14418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510105856 00000100:00100000:2.0:1789181605.436002:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789181605.436014:0:14418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bbaddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:486954f1-c2e6-402a-b3c8-096af476560c+14:15105:x1876092510105856:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789181605.436040:0:14418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181605.436057:0:14418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc1c0259600/0x8f4f7840b2e422aa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f4f7840b2e422a3 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181605.436092:0:14418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc1c0259600/0x8f4f7840b2e422aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f4f7840b2e422a3 expref: 15 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181605.436102:0:14418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc1c0259600/0x8f4f7840b2e422aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e422a3 expref: 15 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181605.436111:0:14418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1c0259600, rc 0) 00000100:00100000:2.0:1789181605.436169:0:14418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bbaddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:486954f1-c2e6-402a-b3c8-096af476560c+15:15105:x1876092510105856:12345-0@lo:101:mount.lustre.0 Request processed in 158us (1473us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181605.436185:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789181605.436516:0:15105:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6e5e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:15105:1876092510105856:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789181605.436537:0:15105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.132@tcp lock: ffff9dc18151be00/0x8f4f7840b2e422a3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e422aa expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181605.436546:0:15105:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.132@tcp lock: ffff9dc18151be00/0x8f4f7840b2e422a3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f4f7840b2e422aa expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789181605.438533:0:15105:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1789181605.440621:0:15105:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789181605.441174:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1789181605.441301:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1789181605.441399:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1789181605.441408:0:15105:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1789181605.441515:0:15105:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6e5e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:15105:1876092510105984:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789181605.441584:0:15105:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181605.441684:0:15105:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1c10b2600 going to sleep for 11 seconds 00000100:00100000:2.0:1789181605.441729:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510105984 00000100:00100000:2.0:1789181605.441737:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510105984 00000100:00100000:2.0:1789181605.441866:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789181605.441878:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bbadc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:486954f1-c2e6-402a-b3c8-096af476560c+15:15105:x1876092510105984:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789181605.442308:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bbadc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:486954f1-c2e6-402a-b3c8-096af476560c+15:15105:x1876092510105984:12345-0@lo:501:mount.lustre.0 Request processed in 432us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181605.442316:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789181605.442462:0:15105:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6e5e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:15105:1876092510105984:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789181605.442501:0:15105:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c01c5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:15105:1876092510106112:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789181605.442546:0:15105:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181605.442563:0:15105:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1906600c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789181605.442610:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510106112 00000100:00100000:2.0:1789181605.442615:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510106112 00000100:00100000:2.0:1789181605.442672:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789181605.442680:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bbade850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:486954f1-c2e6-402a-b3c8-096af476560c+15:15105:x1876092510106112:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789181605.443148:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bbade850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:486954f1-c2e6-402a-b3c8-096af476560c+15:15105:x1876092510106112:12345-0@lo:503:mount.lustre.0 Request processed in 467us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181605.443155:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789181605.443246:0:15105:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c01c5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:15105:1876092510106112:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789181605.444111:0:15105:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789181605.444277:0:15105:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c01c5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:15105:1876092510106240:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789181605.444358:0:15105:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181605.444585:0:15105:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1906600c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789181605.444729:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510106240 00000100:00100000:1.0:1789181605.444737:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510106240 00000100:00100000:1.0:1789181605.444782:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789181605.444792:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bbade050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:486954f1-c2e6-402a-b3c8-096af476560c+15:15105:x1876092510106240:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789181605.445048:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bbade050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:486954f1-c2e6-402a-b3c8-096af476560c+15:15105:x1876092510106240:12345-0@lo:502:mount.lustre.0 Request processed in 257us (690us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181605.445056:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789181605.445358:0:15105:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c01c5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:15105:1876092510106240:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789181605.445595:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1789181605.445649:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1789181605.445701:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1789181605.445747:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1789181605.446154:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1789181605.446300:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1789181605.446358:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1789181605.446406:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1789181605.446447:0:15105:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6e5ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:15105:1876092510106368:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789181605.446504:0:15105:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181605.446588:0:15105:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1c10b2840 going to sleep for 11 seconds 00000100:00100000:0.0:1789181605.446627:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510106368 00000100:00100000:0.0:1789181605.446633:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510106368 00000100:00100000:0.0:1789181605.446714:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789181605.446724:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc081806c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:486954f1-c2e6-402a-b3c8-096af476560c+15:15105:x1876092510106368:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789181605.448678:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc081806c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:486954f1-c2e6-402a-b3c8-096af476560c+15:15105:x1876092510106368:12345-0@lo:502:mount.lustre.0 Request processed in 1946us (2164us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181605.448692:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789181605.448798:0:15105:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6e5ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:15105:1876092510106368:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789181605.448967:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1789181605.448982:0:15105:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1789181605.457158:0:15124:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789181605.457171:0:15124:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789181605.457174:0:15124:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789181605.457179:0:15124:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dc1a68c7800 00000020:00000080:3.0:1789181605.457182:0:15124:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789181605.457189:0:15124:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789181605.457191:0:15124:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789181605.457192:0:15124:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1789181605.457194:0:15124:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789181605.457196:0:15124:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789181605.457209:0:15124:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789181605.457213:0:15124:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dc1a68c7800 00000020:00000080:3.0:1789181605.457214:0:15124:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789181605.457279:0:15124:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789181605.457283:0:15124:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789181605.457285:0:15124:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789181605.457287:0:15124:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789181605.457289:0:15124:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789181605.457290:0:15124:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789181605.457293:0:15124:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9dc1a68c7800 00000020:00000080:3.0:1789181605.457295:0:15124:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789181605.457359:0:15124:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789181605.457364:0:15124:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789181605.457366:0:15124:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1789181605.457370:0:15124:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1789181605.457805:0:15105:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1789181605.457837:0:15105:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789181605.457860:0:15105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc18151be00/0x8f4f7840b2e422a3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e422aa expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181605.457872:0:15105:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.132@tcp lock: ffff9dc18151be00/0x8f4f7840b2e422a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e422aa expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789181605.457919:0:15105:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789181605.457922:0:15105:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9dc1a68c7800 10000000:01000000:1.0:1789181605.457924:0:15105:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9dc1a68c7800 10000000:01000000:1.0:1789181605.457928:0:15105:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789181605.457933:0:15105:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9dc1a68c7800 from 1 10000000:01000000:1.0:1789181605.457936:0:15105:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789181605.457970:0:15105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc18151a400/0x8f4f7840b2e422b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181605.457979:0:15105:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.132@tcp lock: ffff9dc18151a400/0x8f4f7840b2e422b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181605.457989:0:15105:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.132@tcp lock: ffff9dc18151a400/0x8f4f7840b2e422b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181605.458036:0:15105:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6e5ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:15105:1876092510106496:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789181605.458115:0:15105:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181605.458162:0:15105:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1c10b2d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789181605.458658:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510106496 00000100:00100000:3.0:1789181605.458665:0:14418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510106496 00000100:00100000:3.0:1789181605.458711:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789181605.458723:0:14418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc081804450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:486954f1-c2e6-402a-b3c8-096af476560c+15:15105:x1876092510106496:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789181605.458738:0:14418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181605.458753:0:14418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc1bfa1fa00/0x8f4f7840b2e422b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f4f7840b2e422b1 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181605.458779:0:14418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc1bfa1fa00/0x8f4f7840b2e422b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f4f7840b2e422b1 expref: 16 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181605.458790:0:14418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc1bfa1fa00/0x8f4f7840b2e422b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e422b1 expref: 16 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181605.458799:0:14418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1bfa1fa00, rc 0) 00000100:00100000:3.0:1789181605.458849:0:14418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc081804450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:486954f1-c2e6-402a-b3c8-096af476560c+16:15105:x1876092510106496:12345-0@lo:101:mount.lustre.0 Request processed in 130us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181605.458864:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789181605.459176:0:15105:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6e5ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:15105:1876092510106496:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789181605.459194:0:15105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.132@tcp lock: ffff9dc18151a400/0x8f4f7840b2e422b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e422b8 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181605.459204:0:15105:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.132@tcp lock: ffff9dc18151a400/0x8f4f7840b2e422b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f4f7840b2e422b8 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789181605.459865:0:15105:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1789181605.460883:0:15105:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789181605.461477:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1789181605.461532:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1789181605.461570:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1789181605.461632:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1789181605.461672:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1789181605.461721:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1789181605.461759:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1789181605.461796:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1789181605.461847:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1789181605.461885:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1789181605.461918:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1789181605.461964:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1789181605.461999:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1789181605.462045:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1789181605.463954:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1789181605.464008:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1789181605.464053:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1789181605.464115:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1789181605.464151:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1789181605.464366:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1789181605.464425:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1789181605.464465:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1789181605.464504:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1789181605.464556:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1789181605.464591:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1789181605.464626:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1789181605.464677:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1789181605.464725:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1789181605.464819:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1789181605.464827:0:15105:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:1.0:1789181605.464943:0:15105:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6e5df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:15105:1876092510106624:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789181605.465014:0:15105:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181605.465889:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510106624 00000100:00100000:2.0:1789181605.465899:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510106624 00000100:00100000:2.0:1789181605.465958:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789181605.465968:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc081805c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:486954f1-c2e6-402a-b3c8-096af476560c+16:15105:x1876092510106624:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789181605.466411:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc081805c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:486954f1-c2e6-402a-b3c8-096af476560c+16:15105:x1876092510106624:12345-0@lo:501:mount.lustre.0 Request processed in 444us (1396us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181605.466421:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789181605.466879:0:15105:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1c10b2b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789181605.466905:0:15105:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6e5df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:15105:1876092510106624:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789181605.466951:0:15105:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6e5df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:15105:1876092510106752:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789181605.466996:0:15105:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181605.467016:0:15105:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1c10b2b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789181605.467723:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510106752 00000100:00100000:2.0:1789181605.467731:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510106752 00000100:00100000:2.0:1789181605.467786:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789181605.467794:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc081807850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:486954f1-c2e6-402a-b3c8-096af476560c+16:15105:x1876092510106752:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789181605.467976:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc081807850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:486954f1-c2e6-402a-b3c8-096af476560c+16:15105:x1876092510106752:12345-0@lo:503:mount.lustre.0 Request processed in 182us (979us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181605.467983:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789181605.468425:0:15105:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6e5df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:15105:1876092510106752:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789181605.471505:0:15105:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789181605.471609:0:15105:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6e5df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:15105:1876092510106880:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789181605.471690:0:15105:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181605.471730:0:15105:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1c10b2b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789181605.472255:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510106880 00000100:00100000:2.0:1789181605.472264:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510106880 00000100:00100000:2.0:1789181605.472317:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789181605.472355:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc081804850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:486954f1-c2e6-402a-b3c8-096af476560c+16:15105:x1876092510106880:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789181605.472599:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc081804850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:486954f1-c2e6-402a-b3c8-096af476560c+16:15105:x1876092510106880:12345-0@lo:502:mount.lustre.0 Request processed in 273us (909us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181605.472609:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789181605.473191:0:15105:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6e5df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:15105:1876092510106880:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789181605.473571:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1789181605.473661:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1789181605.473717:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1789181605.476505:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1789181605.476605:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1789181605.476659:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1789181605.476697:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1789181605.476735:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1789181605.476799:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1789181605.476836:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1789181605.476869:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1789181605.476939:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1789181605.476982:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1789181605.477020:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1789181605.479462:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1789181605.479529:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1789181605.479559:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1789181605.479627:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1789181605.479663:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1789181605.479696:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1789181605.479745:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1789181605.484062:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1789181605.484358:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1789181605.484493:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1789181605.484554:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1789181605.484598:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1789181605.484675:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1789181605.484732:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1789181605.484783:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1789181605.484872:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1789181605.486458:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1789181605.486500:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1789181605.486530:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1789181605.486617:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1789181605.486656:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1789181605.486703:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1789181605.486740:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1789181605.486774:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1789181605.486851:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1789181605.488105:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1789181605.488324:0:15105:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6e5df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:15105:1876092510107008:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789181605.488427:0:15105:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181605.488480:0:15105:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1c10b2b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789181605.489913:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510107008 00000100:00100000:0.0:1789181605.489925:0:14418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510107008 00000100:00100000:0.0:1789181605.489978:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789181605.489987:0:14418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc081805850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:486954f1-c2e6-402a-b3c8-096af476560c+16:15105:x1876092510107008:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789181605.490672:0:14418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc081805850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:486954f1-c2e6-402a-b3c8-096af476560c+16:15105:x1876092510107008:12345-0@lo:502:mount.lustre.0 Request processed in 685us (2244us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181605.490689:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789181605.495211:0:15105:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6e5df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:15105:1876092510107008:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789181605.495426:0:15105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1789181605.495446:0:15105:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1789181605.498527:0:15129:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1789181605.498684:0:15129:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9dc1a7c0cd40) 00000020:00000080:3.0:1789181605.498707:0:15129:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1789181605.501996:0:15129:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dc1a68c7800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789181605.502008:0:15129:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dc1a68c7800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789181605.502012:0:15129:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dc1a68c7800 3 00010000:00080000:3.0:1789181605.502063:0:15129:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dc1b66e0000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.132@tcp at head 00010000:00010000:3.0:1789181605.503956:0:15129:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:3.0:1789181605.504157:0:15129:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1789181605.504193:0:15129:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789181605.504207:0:15129:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x8f4f7840b2e422c6 00000100:00080000:3.0:1789181605.504218:0:15129:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789181605.504230:0:15129:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9dc1b66e0000 using connection 192.168.204.132@tcp/0@lo 00000100:00100000:3.0:1789181605.504264:0:15129:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc1988c2d80 x1876092510107136/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789181605.504293:0:15129:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789181605.504313:0:11922:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789181605.504318:0:11922:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789181605.504321:0:11922:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789181605.504324:0:11922:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789181605.504366:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1988c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3302:1876092510107136:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789181605.504438:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181605.505483:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789181605.505498:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1988c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876092510107264:0@lo:400:kworker.0 00000100:00100000:1.0:1789181605.505600:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181605.505834:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510107136 00000100:00100000:2.0:1789181605.505844:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510107136 00000100:00100000:2.0:1789181605.505879:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510107264 00000100:00100000:2.0:1789181605.505883:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510107264 00000100:00100000:2.0:1789181605.505922:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789181605.505931:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6e5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876092510107264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181605.506002:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6e5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876092510107264:12345-0@lo:400:kworker.0 Request processed in 71us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181605.506011:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789181605.506044:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789181605.506049:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9dc1988c3100 x1876092510107264/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181621 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181605.506053:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0833d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3302:x1876092510107136:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789181605.506068:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1988c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876092510107264:0@lo:400:kworker.0 00010000:00080000:2.0:1789181605.506089:0:14423:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 497 last 0 00000020:00000080:2.0:1789181605.506123:0:14423:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x8f4f7840b2e422cd 00000004:00100000:2.0:1789181605.506137:0:14423:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789181605.506164:0:14423:0:(import.c:65:import_set_state_nolock()) ffff9dc1bfb9e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789181605.506204:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0833d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876092510107136:12345-0@lo:38:llog_process_th.0 Request processed in 152us (1768us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181605.506212:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789181605.506240:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9dc1988c2d80 x1876092510107136/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789181615 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181605.506250:0:3302:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789181605.506256:0:3302:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1789181605.506264:0:3302:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789181605.506269:0:3302:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789181605.506271:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9dc1b66e0000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789181605.506277:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1988c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3302:1876092510107136:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1789181605.514037:0:15129:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:3.0:1789181605.514985:0:15105:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1789181605.515036:0:15105:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789181605.515066:0:15105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc18151a400/0x8f4f7840b2e422b1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e422b8 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181605.515093:0:15105:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.132@tcp lock: ffff9dc18151a400/0x8f4f7840b2e422b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e422b8 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789181605.515147:0:15105:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789181605.515150:0:15105:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789181605.515151:0:15105:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789181605.515152:0:15105:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789181605.515154:0:15105:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789181605.515155:0:15105:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789181605.515156:0:15105:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789181605.515158:0:15105:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789181605.515160:0:15105:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789181605.515164:0:15105:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1789181605.515166:0:15105:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789181605.515167:0:15105:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789181605.515168:0:15105:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789181605.515169:0:15105:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789181605.515170:0:15105:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789181605.515171:0:15105:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789181605.515172:0:15105:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789181605.515173:0:15105:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789181605.515174:0:15105:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789181605.515200:0:15105:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1789181605.515220:0:15105:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1988c3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:15105:1876092510107392:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789181605.515297:0:15105:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181605.515357:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510107392 00000100:00100000:1.0:1789181605.515368:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510107392 00000100:00100000:3.0:1789181605.515377:0:15105:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1ba9f5480 going to sleep for 11 seconds 00000100:00100000:1.0:1789181605.515419:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789181605.515431:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c1ce0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:486954f1-c2e6-402a-b3c8-096af476560c+16:15105:x1876092510107392:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789181605.515459:0:14417:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1789181605.515473:0:14417:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1789181605.561218:0:14417:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789181605.561237:0:14417:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1789181605.561307:0:14439:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789181605.561313:0:14439:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789181605.561364:0:14439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dc1c0258a00/0x8f4f7840b2e422d4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181605.561396:0:14439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dc189890800/0x8f4f7840b2e42241 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e4223a expref: 16 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181605.561405:0:14439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9dc1c0258a00/0x8f4f7840b2e422d4 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181605.561445:0:14439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dc189890800/0x8f4f7840b2e42241 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8f4f7840b2e4223a expref: 16 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181605.561460:0:14439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dc189890800/0x8f4f7840b2e42241 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8f4f7840b2e4223a expref: 16 pid: 14416 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181605.561476:0:14439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0833d2d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14439:1876092510107520:0@lo:104: 00000100:00100000:2.0:1789181605.561541:0:14439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181605.561588:0:14439:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc199006840 going to sleep for 11 seconds 00000100:00100000:0.0:1789181605.561817:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510107520 00000100:00100000:0.0:1789181605.561825:0:14407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510107520 00000100:00100000:0.0:1789181605.561868:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789181605.561878:0:14407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0833d1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:486954f1-c2e6-402a-b3c8-096af476560c+3:14439:x1876092510107520:12345-0@lo:104: 00010000:00010000:0.0:1789181605.561891:0:14407:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.132@tcp lock: ffff9dc1c0259e00/0x8f4f7840b2e4223a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f4f7840b2e42241 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181605.561957:0:14407:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789181605.561964:0:14407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0833d1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:486954f1-c2e6-402a-b3c8-096af476560c+3:14439:x1876092510107520:12345-0@lo:104: Request processed in 88us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181605.561970:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789181605.561986:0:14439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc0833d2d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14439:1876092510107520:0@lo:104: 00010000:00010000:3.0:1789181605.562007:0:14439:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9dc1c0258a00/0x8f4f7840b2e422d4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181605.562068:0:14412:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789181605.562074:0:14412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.132@tcp lock: ffff9dc1c0259e00/0x8f4f7840b2e4223a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f4f7840b2e42241 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181605.562082:0:14412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1c0259e00 already unused, calling callback (ffffffffc1b45c20) 10000000:00010000:2.0:1789181605.562086:0:14412:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.132@tcp lock: ffff9dc1c0259e00/0x8f4f7840b2e4223a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8f4f7840b2e42241 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181605.562094:0:14412:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.132@tcp lock: ffff9dc1c0259e00/0x8f4f7840b2e4223a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8f4f7840b2e42241 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789181605.562102:0:14412:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.132@tcp lock: ffff9dc1c0259e00/0x8f4f7840b2e4223a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8f4f7840b2e42241 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789181605.562120:0:14412:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789181605.562159:0:14412:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.132@tcp lock: ffff9dc1c0259e00/0x8f4f7840b2e4223a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e42241 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181605.562166:0:14412:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789181605.562188:0:14412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.132@tcp lock: ffff9dc1c0259e00/0x8f4f7840b2e4223a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e42241 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181605.562196:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.132@tcp lock: ffff9dc1c0259e00/0x8f4f7840b2e4223a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e42241 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181605.562211:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181605.562213:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181605.562214:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181605.562222:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789181605.562232:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0833d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:486954f1-c2e6-402a-b3c8-096af476560c:3305:1876092510107648:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789181605.562261:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181605.562325:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510107648 00000100:00100000:3.0:1789181605.562348:0:14410:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510107648 00010000:00010000:3.0:1789181605.562370:0:14410:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dc189890800/0x8f4f7840b2e42241 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f4f7840b2e4223a expref: 17 pid: 14416 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181605.562397:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789181605.562405:0:14410:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0833d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:486954f1-c2e6-402a-b3c8-096af476560c+17:3305:x1876092510107648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789181605.562416:0:14410:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789181605.562421:0:14410:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dc189890800/0x8f4f7840b2e42241 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f4f7840b2e4223a expref: 17 pid: 14416 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181605.562431:0:14410:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dc189890800/0x8f4f7840b2e42241 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8f4f7840b2e4223a expref: 17 pid: 14416 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181605.562443:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc189890800/0x8f4f7840b2e42241 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8f4f7840b2e4223a expref: 17 pid: 14416 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181605.562455:0:14410:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9dc1c0258a00/0x8f4f7840b2e422d4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181605.562462:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc1c0258a00/0x8f4f7840b2e422d4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789181605.562474:0:14410:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003978598s 00010000:00010000:3.0:1789181605.562478:0:14410:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dc1c0258a00/0x8f4f7840b2e422d4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181605.562485:0:14410:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dc1c0258a00/0x8f4f7840b2e422d4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181605.562492:0:14410:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dc1c0258a00/0x8f4f7840b2e422d4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181605.562509:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dc1c0258a00/0x8f4f7840b2e422d4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181605.562515:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1c0258a00 already unused, calling callback (ffffffffc152f9b0) 00010000:00010000:3.0:1789181605.562519:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dc1c0258a00/0x8f4f7840b2e422d4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181605.562528:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dc1c0258a00/0x8f4f7840b2e422d4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181605.562549:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dc1c0258a00/0x8f4f7840b2e422d4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181605.562559:0:14410:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789181605.562591:0:14410:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0833d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:486954f1-c2e6-402a-b3c8-096af476560c+16:3305:x1876092510107648:12345-0@lo:103:ldlm_bl.0 Request processed in 187us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181605.562598:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1789181605.562602:0:14439:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9dc1c0258a00/0x8f4f7840b2e422d4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181605.562609:0:14439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dc1c0258a00/0x8f4f7840b2e422d4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181605.562616:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc1c0258a00/0x8f4f7840b2e422d4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181605.562665:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc0833d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:486954f1-c2e6-402a-b3c8-096af476560c:3305:1876092510107648:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789181605.570239:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c1ce0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:486954f1-c2e6-402a-b3c8-096af476560c+15:15105:x1876092510107392:12345-0@lo:253:mount.lustre.0 Request processed in 54803us (54935us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181605.570253:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789181605.570471:0:15105:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1988c3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:15105:1876092510107392:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789181605.570487:0:15105:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789181605.570491:0:15105:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789181605.570493:0:15105:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789181605.570494:0:15105:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789181605.570496:0:15105:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789181605.570497:0:15105:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789181605.570498:0:15105:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789181605.570500:0:15105:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789181605.570502:0:15105:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789181605.570503:0:15105:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789181605.570519:0:15105:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1789181605.578129:0:15105:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1789181605.578315:0:15105:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1789181605.578686:0:15105:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1789181605.579191:0:15105:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1789181605.579359:0:15105:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1789181605.579567:0:15105:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1789181605.580571:0:15105:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1789181605.640832:0:15105:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1789181605.640842:0:15105:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1789181605.640874:0:15105:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789181605.640937:0:15105:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.132@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789181605.640958:0:15105:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1789181605.640986:0:15105:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1789181606.081734:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789181606.785692:0:14420:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789181606.785702:0:14420:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9dc1ba454000 from 7 10000000:01000000:0.0:1789181606.785708:0:14420:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789181606.785757:0:14420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc189890e00/0x8f4f7840b2e422db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181606.785769:0:14420:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.132@tcp lock: ffff9dc189890e00/0x8f4f7840b2e422db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181606.785789:0:14420:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.132@tcp lock: ffff9dc189890e00/0x8f4f7840b2e422db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181606.785816:0:14420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c01c5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:486954f1-c2e6-402a-b3c8-096af476560c:14420:1876092510107776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789181606.785888:0:14420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181606.785935:0:14420:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1c062ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1789181606.786392:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510107776 00000100:00100000:3.0:1789181606.786726:0:14418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510107776 00000100:00100000:3.0:1789181606.786909:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789181606.786921:0:14418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c1ce1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:486954f1-c2e6-402a-b3c8-096af476560c+15:14420:x1876092510107776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789181606.786937:0:14418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181606.786956:0:14418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc1bfa1f200/0x8f4f7840b2e422e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f4f7840b2e422db expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181606.786983:0:14418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc1bfa1f200/0x8f4f7840b2e422e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f4f7840b2e422db expref: 16 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181606.786994:0:14418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc1bfa1f200/0x8f4f7840b2e422e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e422db expref: 16 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181606.787028:0:14418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1bfa1f200, rc 0) 00000100:00100000:3.0:1789181606.787097:0:14418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c1ce1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:486954f1-c2e6-402a-b3c8-096af476560c+16:14420:x1876092510107776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 180us (1209us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181606.787104:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789181606.787417:0:14420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c01c5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:486954f1-c2e6-402a-b3c8-096af476560c:14420:1876092510107776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789181606.787435:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.132@tcp lock: ffff9dc189890e00/0x8f4f7840b2e422db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e422e2 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181606.787444:0:14420:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.132@tcp lock: ffff9dc189890e00/0x8f4f7840b2e422db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f4f7840b2e422e2 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181606.787502:0:14420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0833d3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:486954f1-c2e6-402a-b3c8-096af476560c:14420:1876092510107904:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789181606.787540:0:14420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181606.787581:0:14420:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc199006840 going to sleep for 11 seconds 00000100:00100000:2.0:1789181606.787599:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510107904 00000100:00100000:2.0:1789181606.787604:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510107904 00000100:00100000:2.0:1789181606.795389:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789181606.795422:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c1ce1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:486954f1-c2e6-402a-b3c8-096af476560c+16:14420:x1876092510107904:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789181606.795454:0:14417:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789181606.795471:0:14417:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789181606.795474:0:14417:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1789181606.796192:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c1ce1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:486954f1-c2e6-402a-b3c8-096af476560c+16:14420:x1876092510107904:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 775us (8647us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181606.796203:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789181606.796321:0:14420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc0833d3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:486954f1-c2e6-402a-b3c8-096af476560c:14420:1876092510107904:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789181606.796434:0:14420:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789181606.796444:0:14420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc189890e00/0x8f4f7840b2e422db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e422e2 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181606.796455:0:14420:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.132@tcp lock: ffff9dc189890e00/0x8f4f7840b2e422db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e422e2 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181607.102569:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181608.126966:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181609.152385:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181610.175318:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789181611.007367:0:11922:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789181611.007374:0:11922:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789181611.007377:0:11922:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789181611.007380:0:11922:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789181611.008112:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1988c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:486954f1-c2e6-402a-b3c8-096af476560c:3303:1876092510108032:0@lo:400:kworker.0 00000100:00100000:3.0:1789181611.008181:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181611.008230:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789181611.008237:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1988c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876092510108160:0@lo:400:kworker.0 00000100:00100000:3.0:1789181611.008261:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181611.008299:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1988c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1876092510108288:0@lo:400:kworker.0 00000100:00100000:3.0:1789181611.008326:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181611.008666:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510108032 00000100:00100000:3.0:1789181611.008674:0:14418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510108032 00000100:00100000:3.0:1789181611.008717:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789181611.008726:0:14418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c1ce0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:486954f1-c2e6-402a-b3c8-096af476560c+16:3303:x1876092510108032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181611.008779:0:14418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c1ce0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:486954f1-c2e6-402a-b3c8-096af476560c+16:3303:x1876092510108032:12345-0@lo:400:kworker.0 Request processed in 53us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181611.008830:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789181611.008880:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510108160 00000100:00100000:3.0:1789181611.008884:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510108160 00000100:00100000:3.0:1789181611.008907:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510108288 00000100:00100000:3.0:1789181611.008909:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510108288 00000100:00100000:3.0:1789181611.008949:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789181611.008956:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1988c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876092510108160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181611.008987:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1988c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876092510108160:12345-0@lo:400:kworker.0 Request processed in 32us (724us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181611.008993:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1789181611.008995:0:14419:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789181611.009430:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789181611.009439:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1988c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876092510108288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181611.009547:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1988c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876092510108288:12345-0@lo:400:kworker.0 Request processed in 109us (1219us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181611.009554:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1789181611.010253:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dc1988c1180 x1876092510108160/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181627 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181611.010270:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1988c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876092510108160:0@lo:400:kworker.0 00000100:00100000:3.0:1789181611.010287:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1988c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:486954f1-c2e6-402a-b3c8-096af476560c:3303:1876092510108032:0@lo:400:kworker.0 00010000:00080000:3.0:1789181611.010354:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dc1988c1500 x1876092510108288/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181627 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181611.010365:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1988c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1876092510108288:0@lo:400:kworker.0 00010000:00010000:3.0:1789181611.198483:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789181611.854539:0:15473:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg432-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789181612.223061:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181613.248359:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181614.270680:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789181614.591113:0:14458:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789181615.294491:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789181616.126653:0:11922:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789181616.126662:0:11922:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789181616.126666:0:11922:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789181616.126669:0:11922:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789181616.126760:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1988c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:486954f1-c2e6-402a-b3c8-096af476560c:3306:1876092510108416:0@lo:400:kworker.0 00000100:00100000:3.0:1789181616.126851:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181616.126926:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1988c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876092510108544:0@lo:400:kworker.0 00000100:00100000:3.0:1789181616.126960:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181616.126984:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789181616.126990:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1988c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1876092510108672:0@lo:400:kworker.0 00000100:00100000:3.0:1789181616.127012:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181616.127157:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510108544 00000100:00100000:3.0:1789181616.127229:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510108544 00000100:00100000:3.0:1789181616.127269:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510108672 00000100:00100000:3.0:1789181616.127272:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510108672 00000100:00100000:3.0:1789181616.127296:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789181616.127304:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1988c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876092510108544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181616.127479:0:14425:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1789181616.127488:0:14425:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1789181616.127512:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1988c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876092510108544:12345-0@lo:400:kworker.0 Request processed in 207us (550us total) trans 0 rc 0/0 00000100:00080000:1.0:1789181616.127514:0:14419:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789181616.127520:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789181616.127539:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789181616.127546:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1988c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876092510108672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181616.127575:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1988c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876092510108672:12345-0@lo:400:kworker.0 Request processed in 29us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181616.127581:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1789181616.127615:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dc1988c1180 x1876092510108672/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181632 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181616.127628:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1988c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1876092510108672:0@lo:400:kworker.0 00010000:00080000:3.0:1789181616.127638:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dc1988c0700 x1876092510108544/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181632 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181616.127658:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1988c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876092510108544:0@lo:400:kworker.0 00000100:00100000:2.0:1789181616.127985:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510108416 00000100:00100000:2.0:1789181616.127991:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510108416 00000100:00100000:2.0:1789181616.128019:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789181616.128027:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c1ce3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:486954f1-c2e6-402a-b3c8-096af476560c+16:3306:x1876092510108416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181616.128074:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c1ce3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:486954f1-c2e6-402a-b3c8-096af476560c+16:3306:x1876092510108416:12345-0@lo:400:kworker.0 Request processed in 48us (1222us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181616.128081:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789181616.128115:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1988c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:486954f1-c2e6-402a-b3c8-096af476560c:3306:1876092510108416:0@lo:400:kworker.0 00010000:00010000:2.0:1789181616.321497:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789181616.767525:0:3302:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789181601/real 1789181601] req@ffff9dc1b6e5ce00 x1876092510103936/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789181616 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181616.767555:0:3302:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9dc1b6e5ce00 x1876092510103936/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789181616 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789181616.767575:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9dc1c1dc0800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789181616.767590:0:3302:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789181616.767594:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6e5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1876092510103936:0@lo:8:kworker.0 00000100:00080000:3.0:1789181616.767685:0:11922:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789181616.767690:0:11922:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1789181616.767693:0:11922:0:(import.c:65:import_set_state_nolock()) ffff9dc1c1dc0800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789181616.767697:0:11922:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 493 00000100:00080000:3.0:1789181616.767703:0:11922:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789181616.767714:0:11922:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9dc1c1dc0800 using connection 192.168.204.132@tcp/0@lo 00000100:00100000:3.0:1789181616.767734:0:11922:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc1988c1180 x1876092510108928/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789181616.767755:0:11922:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789181616.767758:0:11922:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789181616.767799:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1988c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:486954f1-c2e6-402a-b3c8-096af476560c:3305:1876092510108800:0@lo:400:kworker.0 00000100:00100000:3.0:1789181616.767879:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181616.767918:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1988c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876092510109056:0@lo:400:kworker.0 00000100:00100000:3.0:1789181616.767933:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1988c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1876092510109184:0@lo:400:kworker.0 00000100:00100000:0.0:1789181616.767948:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181616.767964:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510108800 00000100:00100000:3.0:1789181616.767976:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510108800 00000100:00100000:3.0:1789181616.768026:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789181616.768036:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c1ce1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:486954f1-c2e6-402a-b3c8-096af476560c+16:3305:x1876092510108800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181616.768081:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c1ce1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:486954f1-c2e6-402a-b3c8-096af476560c+16:3305:x1876092510108800:12345-0@lo:400:kworker.0 Request processed in 46us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181616.768087:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789181616.768115:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1988c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1876092510108928:0@lo:8:kworker.0 00000100:00100000:3.0:1789181616.768118:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510109056 00000100:00100000:3.0:1789181616.768122:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510109056 00000100:00100000:3.0:1789181616.768151:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789181616.768159:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c01c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876092510109056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181616.768167:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181616.768456:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510108928 00000100:00100000:0.0:1789181616.768461:0:15106:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510108928 00000100:00100000:0.0:1789181616.768482:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789181616.768486:0:15106:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6e5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3302:x1876092510108928:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1789181616.768509:0:15106:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 509 last 0 00000020:00000080:0.0:1789181616.768536:0:15106:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8f4f7840b2e422e9 00000100:00100000:3.0:1789181616.770164:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c01c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876092510109056:12345-0@lo:400:kworker.0 Request processed in 2000us (2208us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181616.770177:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789181616.770223:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181616.770268:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510109184 00000100:00100000:3.0:1789181616.770274:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510109184 00000100:00100000:3.0:1789181616.770762:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789181616.770772:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1988c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876092510109184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181616.771135:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1988c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876092510109184:12345-0@lo:400:kworker.0 Request processed in 365us (911us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181616.771143:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1789181616.771188:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dc1988c3100 x1876092510109056/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181632 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181616.771202:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1988c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876092510109056:0@lo:400:kworker.0 00010000:00080000:3.0:1789181616.771238:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dc1988c2a00 x1876092510109184/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181632 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181616.771259:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1988c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1876092510109184:0@lo:400:kworker.0 00000100:00100000:3.0:1789181616.771282:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1988c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:486954f1-c2e6-402a-b3c8-096af476560c:3305:1876092510108800:0@lo:400:kworker.0 00002000:00100000:0.0:1789181616.772483:0:15106:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9dc1babd3000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1789181616.772491:0:15106:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1789181616.772494:0:15106:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789181616.772831:0:15106:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789181616.773040:0:15106:0:(import.c:65:import_set_state_nolock()) ffff9dc1babd1000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789181616.773180:0:15106:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6e5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3302:x1876092510108928:12345-0@lo:8:kworker.0 Request processed in 4691us (5015us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181616.773189:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789181616.773271:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dc1988c1180 x1876092510108928/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789181636 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181616.773283:0:3302:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789181616.773292:0:3302:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1789181616.773300:0:3302:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789181616.773305:0:3302:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1789181616.773307:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9dc1c1dc0800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789181616.773399:0:14445:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789181616.773615:0:14446:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:0.0:1789181616.773637:0:14446:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c01c4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14446:1876092510109440:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1789181616.773676:0:14446:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181616.773697:0:14446:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1b6f7a780 going to sleep for 11 seconds 00000100:00100000:0.0:1789181616.773715:0:15109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510109440 00000100:00100000:0.0:1789181616.773720:0:15109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510109440 00000004:00080000:2.0:1789181616.773909:0:14445:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 509030576918ns, next at 0ns, rc = 0 00000004:00080000:1.0:1789181616.774115:0:3302:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789181616.774125:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1988c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1876092510108928:0@lo:8:kworker.0 00000100:00100000:0.0:1789181616.775201:0:15109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789181616.775215:0:15109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c01c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14446:x1876092510109440:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1789181616.781662:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c01c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876092510109312:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789181616.781737:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181616.781805:0:15110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510109312 00000100:00100000:1.0:1789181616.781830:0:15110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510109312 00002000:00080000:0.0:1789181616.787915:0:15109:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1789181616.787932:0:15109:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1789181616.787937:0:15109:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00000100:00100000:3.0:1789181616.795703:0:15111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789181616.795721:0:15111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6e5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1876092510109312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789181616.795758:0:15111:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789181616.795853:0:15111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6e5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1876092510109312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 139us (14116us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181616.795861:0:15111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789181616.797386:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dc1c01c5180 x1876092510109312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181632 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181616.797413:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c01c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876092510109312:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789181616.812118:0:14419:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:0.0:1789181616.813229:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789181616.813241:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418c3ab9/0x8f4f7840b2e422f0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181616.813258:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=509s v=(0 0) 00010000:00010000:0.0:1789181616.813263:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789181616.813269:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000418c3ab9/0x8f4f7840b2e422f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181616.813288:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000418c3ab9/0x8f4f7840b2e422f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181616.813299:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000418c3ab9/0x8f4f7840b2e422f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181616.813307:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000418c3ab9/0x8f4f7840b2e422f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181616.813701:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789181616.814237:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789181616.814246:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb663e00/0x8f4f7840b2e422f7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181616.814258:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=509s v=(0 0) 00010000:00010000:0.0:1789181616.814262:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789181616.814274:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb663e00/0x8f4f7840b2e422f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181616.814285:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb663e00/0x8f4f7840b2e422f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181616.814294:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb663e00/0x8f4f7840b2e422f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181616.814303:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb663e00/0x8f4f7840b2e422f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181616.814568:0:14412:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789181616.814576:0:14412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000418c3ab9/0x8f4f7840b2e422f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181616.814585:0:14412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc189890800 already unused, calling callback (ffffffffc152f9b0) 00010000:00010000:2.0:1789181616.814590:0:14412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000418c3ab9/0x8f4f7840b2e422f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181616.814599:0:14412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000418c3ab9/0x8f4f7840b2e422f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181616.814619:0:14412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000418c3ab9/0x8f4f7840b2e422f0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181616.814627:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000418c3ab9/0x8f4f7840b2e422f0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181616.814647:0:14412:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789181616.814650:0:14412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb663e00/0x8f4f7840b2e422f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181616.814664:0:14412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc189891c00 already unused, calling callback (ffffffffc152f9b0) 00010000:00010000:2.0:1789181616.814667:0:14412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb663e00/0x8f4f7840b2e422f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181616.814675:0:14412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb663e00/0x8f4f7840b2e422f7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181616.814685:0:14412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb663e00/0x8f4f7840b2e422f7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181616.814692:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181616.814694:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181616.814696:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181616.814798:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789181616.814803:0:15109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb663e00/0x8f4f7840b2e422f7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789181616.815241:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789181616.815248:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004acd3757/0x8f4f7840b2e422fe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181616.815259:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=509s v=(0 0) 00010000:00010000:0.0:1789181616.815262:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789181616.815266:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004acd3757/0x8f4f7840b2e422fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181616.815276:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004acd3757/0x8f4f7840b2e422fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181616.815297:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004acd3757/0x8f4f7840b2e422fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181616.815305:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004acd3757/0x8f4f7840b2e422fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181616.815676:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789181616.815683:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004acd3757/0x8f4f7840b2e422fe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181616.815691:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc189890a00 already unused, calling callback (ffffffffc152f9b0) 00010000:00010000:2.0:1789181616.815694:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004acd3757/0x8f4f7840b2e422fe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181616.815703:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004acd3757/0x8f4f7840b2e422fe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181616.815715:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004acd3757/0x8f4f7840b2e422fe lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181616.815729:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181616.815731:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181616.815733:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181616.815821:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789181616.815826:0:15109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004acd3757/0x8f4f7840b2e422fe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789181616.816253:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789181616.816260:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001167b336/0x8f4f7840b2e42305 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181616.816270:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=509s v=(0 0) 00010000:00010000:0.0:1789181616.816274:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789181616.816278:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001167b336/0x8f4f7840b2e42305 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181616.816287:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001167b336/0x8f4f7840b2e42305 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181616.816295:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001167b336/0x8f4f7840b2e42305 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181616.816311:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001167b336/0x8f4f7840b2e42305 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181616.816576:0:14412:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789181616.816582:0:14412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001167b336/0x8f4f7840b2e42305 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181616.816589:0:14412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc189891600 already unused, calling callback (ffffffffc152f9b0) 00010000:00010000:2.0:1789181616.816593:0:14412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001167b336/0x8f4f7840b2e42305 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181616.816600:0:14412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001167b336/0x8f4f7840b2e42305 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181616.816612:0:14412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001167b336/0x8f4f7840b2e42305 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181616.816621:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181616.816623:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181616.816625:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181616.816677:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789181616.816683:0:15109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001167b336/0x8f4f7840b2e42305 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181616.816907:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789181616.817256:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789181616.817264:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003734ce4c/0x8f4f7840b2e4230c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181616.817274:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=509s v=(0 0) 00010000:00010000:0.0:1789181616.817279:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789181616.817284:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003734ce4c/0x8f4f7840b2e4230c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181616.817295:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003734ce4c/0x8f4f7840b2e4230c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181616.817305:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003734ce4c/0x8f4f7840b2e4230c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181616.817313:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003734ce4c/0x8f4f7840b2e4230c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181616.817628:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789181616.817906:0:14412:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789181616.817911:0:14412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003734ce4c/0x8f4f7840b2e4230c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181616.817919:0:14412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc189891e00 already unused, calling callback (ffffffffc152f9b0) 00010000:00010000:2.0:1789181616.817929:0:14412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003734ce4c/0x8f4f7840b2e4230c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181616.817938:0:14412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003734ce4c/0x8f4f7840b2e4230c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181616.817951:0:14412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003734ce4c/0x8f4f7840b2e4230c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181616.817958:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003734ce4c/0x8f4f7840b2e4230c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181616.817974:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181616.817976:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181616.817977:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789181616.819804:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789181616.819828:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001bd9c344/0x8f4f7840b2e42313 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181616.820236:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=509s v=(0 0) 00010000:00010000:0.0:1789181616.820245:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789181616.820253:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001bd9c344/0x8f4f7840b2e42313 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181616.820268:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001bd9c344/0x8f4f7840b2e42313 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181616.820278:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001bd9c344/0x8f4f7840b2e42313 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181616.820285:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001bd9c344/0x8f4f7840b2e42313 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181616.820312:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789181616.820594:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789181616.820604:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001bd9c344/0x8f4f7840b2e42313 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.820613:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc189890600 already unused, calling callback (ffffffffc152f9b0) 00010000:00010000:1.0:1789181616.820618:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001bd9c344/0x8f4f7840b2e42313 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.820627:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001bd9c344/0x8f4f7840b2e42313 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.820651:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001bd9c344/0x8f4f7840b2e42313 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.820659:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001bd9c344/0x8f4f7840b2e42313 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.820675:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181616.820677:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181616.820679:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789181616.822314:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789181616.822325:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000734e6fed/0x8f4f7840b2e4231a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181616.823730:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=509s v=(0 0) 00010000:00010000:0.0:1789181616.823747:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789181616.823755:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000734e6fed/0x8f4f7840b2e4231a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181616.823772:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000734e6fed/0x8f4f7840b2e4231a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181616.823783:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000734e6fed/0x8f4f7840b2e4231a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181616.823791:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000734e6fed/0x8f4f7840b2e4231a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.827402:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789181616.828055:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789181616.828065:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d37720bf/0x8f4f7840b2e42321 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.828081:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=509s v=(0 0) 00010000:00010000:1.0:1789181616.828085:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789181616.828093:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d37720bf/0x8f4f7840b2e42321 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.828108:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d37720bf/0x8f4f7840b2e42321 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.828118:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d37720bf/0x8f4f7840b2e42321 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.828126:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d37720bf/0x8f4f7840b2e42321 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.828152:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789181616.828261:0:14412:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789181616.828269:0:14412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000734e6fed/0x8f4f7840b2e4231a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181616.828278:0:14412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc189891800 already unused, calling callback (ffffffffc152f9b0) 00010000:00010000:3.0:1789181616.828282:0:14412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000734e6fed/0x8f4f7840b2e4231a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181616.828293:0:14412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000734e6fed/0x8f4f7840b2e4231a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181616.828313:0:14412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000734e6fed/0x8f4f7840b2e4231a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181616.828321:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000734e6fed/0x8f4f7840b2e4231a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789181616.828545:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789181616.828550:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063e72310/0x8f4f7840b2e42328 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.828559:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=509s v=(0 0) 00010000:00010000:1.0:1789181616.828562:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789181616.828566:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063e72310/0x8f4f7840b2e42328 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.828576:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000063e72310/0x8f4f7840b2e42328 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.828584:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063e72310/0x8f4f7840b2e42328 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.828592:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000063e72310/0x8f4f7840b2e42328 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.828599:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789181616.828605:0:14412:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789181616.828609:0:14412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d37720bf/0x8f4f7840b2e42321 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181616.828616:0:14412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc18151a000 already unused, calling callback (ffffffffc152f9b0) 00010000:00010000:3.0:1789181616.828619:0:14412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d37720bf/0x8f4f7840b2e42321 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181616.828627:0:14412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d37720bf/0x8f4f7840b2e42321 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181616.828638:0:14412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d37720bf/0x8f4f7840b2e42321 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181616.828646:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d37720bf/0x8f4f7840b2e42321 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181616.828657:0:14412:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789181616.828660:0:14412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000063e72310/0x8f4f7840b2e42328 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181616.828666:0:14412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc18151b400 already unused, calling callback (ffffffffc152f9b0) 00010000:00010000:3.0:1789181616.828669:0:14412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000063e72310/0x8f4f7840b2e42328 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181616.828688:0:14412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000063e72310/0x8f4f7840b2e42328 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181616.828699:0:14412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000063e72310/0x8f4f7840b2e42328 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181616.828706:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063e72310/0x8f4f7840b2e42328 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181616.828719:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181616.828720:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181616.828722:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789181616.829060:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789181616.829067:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005993d51a/0x8f4f7840b2e4232f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.829076:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=509s v=(0 0) 00010000:00010000:1.0:1789181616.829085:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789181616.829088:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005993d51a/0x8f4f7840b2e4232f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.829098:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005993d51a/0x8f4f7840b2e4232f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181616.829105:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181616.829106:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005993d51a/0x8f4f7840b2e4232f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.829114:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005993d51a/0x8f4f7840b2e4232f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.829128:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789181616.829135:0:14412:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789181616.829138:0:14412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005993d51a/0x8f4f7840b2e4232f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.829145:0:14412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc18151ac00 already unused, calling callback (ffffffffc152f9b0) 00010000:00010000:1.0:1789181616.829148:0:14412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005993d51a/0x8f4f7840b2e4232f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.829155:0:14412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005993d51a/0x8f4f7840b2e4232f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.829165:0:14412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005993d51a/0x8f4f7840b2e4232f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.829182:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005993d51a/0x8f4f7840b2e4232f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.829194:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181616.829195:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181616.829197:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789181616.829577:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789181616.829583:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb612620/0x8f4f7840b2e42336 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.829591:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=509s v=(0 0) 00010000:00010000:1.0:1789181616.829594:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789181616.829598:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb612620/0x8f4f7840b2e42336 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.829606:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb612620/0x8f4f7840b2e42336 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.829613:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb612620/0x8f4f7840b2e42336 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.829620:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb612620/0x8f4f7840b2e42336 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.829632:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789181616.829639:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789181616.829650:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb612620/0x8f4f7840b2e42336 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.829657:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc18151b000 already unused, calling callback (ffffffffc152f9b0) 00010000:00010000:1.0:1789181616.829660:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb612620/0x8f4f7840b2e42336 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.829668:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb612620/0x8f4f7840b2e42336 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.829679:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb612620/0x8f4f7840b2e42336 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.829686:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb612620/0x8f4f7840b2e42336 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.829700:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181616.829701:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181616.829703:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789181616.830093:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789181616.830099:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059f46ab8/0x8f4f7840b2e4233d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.830108:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=509s v=(0 0) 00010000:00010000:1.0:1789181616.830111:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789181616.830115:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059f46ab8/0x8f4f7840b2e4233d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.830138:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059f46ab8/0x8f4f7840b2e4233d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.830147:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059f46ab8/0x8f4f7840b2e4233d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.830154:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059f46ab8/0x8f4f7840b2e4233d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.830168:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789181616.830176:0:14412:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789181616.830179:0:14412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059f46ab8/0x8f4f7840b2e4233d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.830186:0:14412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc18151ae00 already unused, calling callback (ffffffffc152f9b0) 00010000:00010000:1.0:1789181616.830189:0:14412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059f46ab8/0x8f4f7840b2e4233d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.830197:0:14412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059f46ab8/0x8f4f7840b2e4233d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.836129:0:14412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059f46ab8/0x8f4f7840b2e4233d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.836154:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059f46ab8/0x8f4f7840b2e4233d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.836185:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181616.836187:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181616.836190:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789181616.839658:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789181616.839673:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005993d51a/0x8f4f7840b2e42344 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.839693:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=509s v=(0 0) 00010000:00010000:1.0:1789181616.839698:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789181616.839705:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005993d51a/0x8f4f7840b2e42344 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.839719:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005993d51a/0x8f4f7840b2e42344 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.839731:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005993d51a/0x8f4f7840b2e42344 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.839739:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005993d51a/0x8f4f7840b2e42344 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.839757:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789181616.839769:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789181616.839775:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005993d51a/0x8f4f7840b2e42344 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.839794:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc18151ac00 already unused, calling callback (ffffffffc152f9b0) 00010000:00010000:1.0:1789181616.839798:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005993d51a/0x8f4f7840b2e42344 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.839819:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005993d51a/0x8f4f7840b2e42344 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.839839:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005993d51a/0x8f4f7840b2e42344 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.839847:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005993d51a/0x8f4f7840b2e42344 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.839863:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181616.839865:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181616.839867:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789181616.843163:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789181616.843178:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059f46ab8/0x8f4f7840b2e4234b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.843196:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=509s v=(0 0) 00010000:00010000:1.0:1789181616.843201:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789181616.843207:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059f46ab8/0x8f4f7840b2e4234b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.843221:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059f46ab8/0x8f4f7840b2e4234b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.843240:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059f46ab8/0x8f4f7840b2e4234b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.843247:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059f46ab8/0x8f4f7840b2e4234b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.843268:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789181616.843283:0:14412:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789181616.843288:0:14412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059f46ab8/0x8f4f7840b2e4234b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.843295:0:14412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc18151ae00 already unused, calling callback (ffffffffc152f9b0) 00010000:00010000:1.0:1789181616.843301:0:14412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059f46ab8/0x8f4f7840b2e4234b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.843309:0:14412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059f46ab8/0x8f4f7840b2e4234b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.843325:0:14412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059f46ab8/0x8f4f7840b2e4234b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.843350:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059f46ab8/0x8f4f7840b2e4234b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789181616.844100:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:1.0:1789181616.844180:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181616.844188:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181616.844190:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789181616.847022:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789181616.847035:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005993d51a/0x8f4f7840b2e42352 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.847053:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=509s v=(0 0) 00010000:00010000:1.0:1789181616.847059:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789181616.847065:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005993d51a/0x8f4f7840b2e42352 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.847080:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005993d51a/0x8f4f7840b2e42352 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.847091:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005993d51a/0x8f4f7840b2e42352 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.847099:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005993d51a/0x8f4f7840b2e42352 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.847122:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789181616.847139:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789181616.847145:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005993d51a/0x8f4f7840b2e42352 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.847153:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc18151ac00 already unused, calling callback (ffffffffc152f9b0) 00010000:00010000:1.0:1789181616.847158:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005993d51a/0x8f4f7840b2e42352 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.847179:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005993d51a/0x8f4f7840b2e42352 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.847195:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005993d51a/0x8f4f7840b2e42352 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.847203:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005993d51a/0x8f4f7840b2e42352 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.847220:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181616.847222:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181616.847224:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789181616.847713:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789181616.847720:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb612620/0x8f4f7840b2e42359 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.847730:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=509s v=(0 0) 00010000:00010000:1.0:1789181616.847734:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789181616.847738:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb612620/0x8f4f7840b2e42359 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.847749:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb612620/0x8f4f7840b2e42359 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.847758:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb612620/0x8f4f7840b2e42359 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.847773:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb612620/0x8f4f7840b2e42359 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.847789:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789181616.847799:0:14412:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789181616.847804:0:14412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb612620/0x8f4f7840b2e42359 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.847824:0:14412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc18151b000 already unused, calling callback (ffffffffc152f9b0) 00010000:00010000:1.0:1789181616.847827:0:14412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb612620/0x8f4f7840b2e42359 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.847836:0:14412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb612620/0x8f4f7840b2e42359 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.847848:0:14412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb612620/0x8f4f7840b2e42359 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.847855:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb612620/0x8f4f7840b2e42359 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.847869:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181616.847871:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181616.847873:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789181616.848312:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789181616.848325:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063e72310/0x8f4f7840b2e42360 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.848353:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=509s v=(0 0) 00010000:00010000:1.0:1789181616.848356:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789181616.848360:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063e72310/0x8f4f7840b2e42360 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.848369:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000063e72310/0x8f4f7840b2e42360 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.848378:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063e72310/0x8f4f7840b2e42360 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.848384:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000063e72310/0x8f4f7840b2e42360 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.848397:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789181616.848404:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789181616.848408:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000063e72310/0x8f4f7840b2e42360 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.848414:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc18151b400 already unused, calling callback (ffffffffc152f9b0) 00010000:00010000:1.0:1789181616.848418:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000063e72310/0x8f4f7840b2e42360 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.848426:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000063e72310/0x8f4f7840b2e42360 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.848444:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000063e72310/0x8f4f7840b2e42360 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.848451:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063e72310/0x8f4f7840b2e42360 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.848464:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181616.848466:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181616.848468:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789181616.848887:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789181616.848892:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d37720bf/0x8f4f7840b2e42367 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.848900:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=509s v=(0 0) 00010000:00010000:1.0:1789181616.848903:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789181616.848906:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d37720bf/0x8f4f7840b2e42367 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.848914:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d37720bf/0x8f4f7840b2e42367 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.848921:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d37720bf/0x8f4f7840b2e42367 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.848927:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d37720bf/0x8f4f7840b2e42367 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.848951:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789181616.848958:0:14412:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789181616.848962:0:14412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d37720bf/0x8f4f7840b2e42367 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.848969:0:14412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc18151a000 already unused, calling callback (ffffffffc152f9b0) 00010000:00010000:1.0:1789181616.848972:0:14412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d37720bf/0x8f4f7840b2e42367 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.848979:0:14412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d37720bf/0x8f4f7840b2e42367 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.848991:0:14412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d37720bf/0x8f4f7840b2e42367 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.848998:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d37720bf/0x8f4f7840b2e42367 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.849012:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181616.849014:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181616.849015:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789181616.852553:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789181616.852568:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059f46ab8/0x8f4f7840b2e4236e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.852585:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=509s v=(0 0) 00010000:00010000:1.0:1789181616.852597:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789181616.852605:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059f46ab8/0x8f4f7840b2e4236e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.852619:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059f46ab8/0x8f4f7840b2e4236e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.852628:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059f46ab8/0x8f4f7840b2e4236e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.852636:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059f46ab8/0x8f4f7840b2e4236e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.852661:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789181616.853494:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789181616.853503:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059f46ab8/0x8f4f7840b2e4236e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181616.853515:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc18151ae00 already unused, calling callback (ffffffffc152f9b0) 00010000:00010000:3.0:1789181616.853520:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059f46ab8/0x8f4f7840b2e4236e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181616.853529:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059f46ab8/0x8f4f7840b2e4236e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181616.853547:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059f46ab8/0x8f4f7840b2e4236e lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181616.853566:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059f46ab8/0x8f4f7840b2e4236e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181616.853585:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181616.853587:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181616.853589:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789181616.855571:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789181616.855693:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f33ab07b/0x8f4f7840b2e42375 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.855710:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=509s v=(0 0) 00010000:00010000:1.0:1789181616.855715:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789181616.855722:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f33ab07b/0x8f4f7840b2e42375 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.855736:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f33ab07b/0x8f4f7840b2e42375 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.855745:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f33ab07b/0x8f4f7840b2e42375 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.855759:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f33ab07b/0x8f4f7840b2e42375 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.855824:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789181616.856309:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789181616.856316:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5577022/0x8f4f7840b2e4237c lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.856324:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=509s v=(0 0) 00010000:00010000:1.0:1789181616.856328:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789181616.856358:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c5577022/0x8f4f7840b2e4237c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.856500:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c5577022/0x8f4f7840b2e4237c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.856510:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5577022/0x8f4f7840b2e4237c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.856517:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c5577022/0x8f4f7840b2e4237c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181616.856696:0:14412:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789181616.856704:0:14412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f33ab07b/0x8f4f7840b2e42375 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181616.856711:0:14412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1baab9000 already unused, calling callback (ffffffffc152f9b0) 00010000:00010000:3.0:1789181616.856716:0:14412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f33ab07b/0x8f4f7840b2e42375 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181616.856725:0:14412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f33ab07b/0x8f4f7840b2e42375 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181616.856741:0:14412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f33ab07b/0x8f4f7840b2e42375 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181616.856748:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f33ab07b/0x8f4f7840b2e42375 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181616.856766:0:14412:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789181616.856770:0:14412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c5577022/0x8f4f7840b2e4237c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181616.856783:0:14412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1baab8e00 already unused, calling callback (ffffffffc152f9b0) 00010000:00010000:3.0:1789181616.856787:0:14412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5577022/0x8f4f7840b2e4237c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181616.856794:0:14412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5577022/0x8f4f7840b2e4237c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181616.856816:0:14412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c5577022/0x8f4f7840b2e4237c lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181616.856825:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181616.856827:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181616.856829:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181616.859947:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789181616.859964:0:15109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c5577022/0x8f4f7840b2e4237c lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181616.860941:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789181616.862064:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789181616.862075:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3930cbd/0x8f4f7840b2e42383 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.862092:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=509s v=(0 0) 00010000:00010000:1.0:1789181616.862097:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789181616.862103:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3930cbd/0x8f4f7840b2e42383 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.862117:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3930cbd/0x8f4f7840b2e42383 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.862128:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3930cbd/0x8f4f7840b2e42383 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.862136:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f3930cbd/0x8f4f7840b2e42383 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.862164:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789181616.863088:0:14412:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789181616.863098:0:14412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f3930cbd/0x8f4f7840b2e42383 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181616.863109:0:14412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1baab8400 already unused, calling callback (ffffffffc152f9b0) 00010000:00010000:2.0:1789181616.863113:0:14412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3930cbd/0x8f4f7840b2e42383 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181616.863123:0:14412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3930cbd/0x8f4f7840b2e42383 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181616.863142:0:14412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f3930cbd/0x8f4f7840b2e42383 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181616.863156:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3930cbd/0x8f4f7840b2e42383 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181616.863176:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181616.863177:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181616.863179:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789181616.863604:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789181616.863611:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb4f77db/0x8f4f7840b2e4238a lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.863622:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=509s v=(0 0) 00010000:00010000:1.0:1789181616.863626:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789181616.863639:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb4f77db/0x8f4f7840b2e4238a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.863649:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb4f77db/0x8f4f7840b2e4238a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.863659:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb4f77db/0x8f4f7840b2e4238a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.863665:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb4f77db/0x8f4f7840b2e4238a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.863687:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789181616.864304:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789181616.864311:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb4f77db/0x8f4f7840b2e4238a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181616.864322:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1baab8600 already unused, calling callback (ffffffffc152f9b0) 00010000:00010000:2.0:1789181616.864326:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb4f77db/0x8f4f7840b2e4238a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181616.864434:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb4f77db/0x8f4f7840b2e4238a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181616.864451:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb4f77db/0x8f4f7840b2e4238a lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181616.864458:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb4f77db/0x8f4f7840b2e4238a lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181616.864474:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181616.864476:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181616.864478:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789181616.866076:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789181616.866086:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b904e63/0x8f4f7840b2e42391 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.866099:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=509s v=(0 0) 00010000:00010000:1.0:1789181616.866104:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789181616.866110:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b904e63/0x8f4f7840b2e42391 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.866122:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b904e63/0x8f4f7840b2e42391 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.866131:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b904e63/0x8f4f7840b2e42391 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.866148:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001b904e63/0x8f4f7840b2e42391 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.866215:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789181616.868353:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789181616.868377:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000850c70ab/0x8f4f7840b2e42398 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.868394:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=509s v=(0 0) 00010000:00010000:1.0:1789181616.868398:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789181616.868404:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000850c70ab/0x8f4f7840b2e42398 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.868418:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000850c70ab/0x8f4f7840b2e42398 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.868427:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000850c70ab/0x8f4f7840b2e42398 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.868435:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000850c70ab/0x8f4f7840b2e42398 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181616.869554:0:14412:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789181616.869566:0:14412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001b904e63/0x8f4f7840b2e42391 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181616.869577:0:14412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1baab8c00 already unused, calling callback (ffffffffc152f9b0) 00010000:00010000:2.0:1789181616.869581:0:14412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001b904e63/0x8f4f7840b2e42391 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181616.869591:0:14412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001b904e63/0x8f4f7840b2e42391 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181616.869608:0:14412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001b904e63/0x8f4f7840b2e42391 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181616.869616:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b904e63/0x8f4f7840b2e42391 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181616.869635:0:14412:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789181616.869640:0:14412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000850c70ab/0x8f4f7840b2e42398 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181616.869646:0:14412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1baab8000 already unused, calling callback (ffffffffc152f9b0) 00010000:00010000:2.0:1789181616.869649:0:14412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000850c70ab/0x8f4f7840b2e42398 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181616.869657:0:14412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000850c70ab/0x8f4f7840b2e42398 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181616.869679:0:14412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000850c70ab/0x8f4f7840b2e42398 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181616.869686:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181616.869687:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181616.869690:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181616.871273:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789181616.871285:0:15109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000850c70ab/0x8f4f7840b2e42398 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789181616.872094:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789181616.872101:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d820c772/0x8f4f7840b2e4239f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.872116:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=509s v=(0 0) 00010000:00010000:1.0:1789181616.872121:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789181616.872127:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d820c772/0x8f4f7840b2e4239f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.872141:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d820c772/0x8f4f7840b2e4239f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.872149:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d820c772/0x8f4f7840b2e4239f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.872156:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d820c772/0x8f4f7840b2e4239f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181616.874957:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789181616.874971:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d820c772/0x8f4f7840b2e4239f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181616.875454:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1baab9600 already unused, calling callback (ffffffffc152f9b0) 00010000:00010000:2.0:1789181616.875461:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d820c772/0x8f4f7840b2e4239f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181616.875476:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d820c772/0x8f4f7840b2e4239f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181616.875500:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d820c772/0x8f4f7840b2e4239f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181616.875513:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181616.875515:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181616.875517:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181616.875599:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789181616.875607:0:15109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d820c772/0x8f4f7840b2e4239f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181616.876059:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789181616.877479:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789181616.877490:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f27abfb/0x8f4f7840b2e423a6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.877517:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=509s v=(0 0) 00010000:00010000:1.0:1789181616.877522:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789181616.877528:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f27abfb/0x8f4f7840b2e423a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.877544:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f27abfb/0x8f4f7840b2e423a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.877556:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f27abfb/0x8f4f7840b2e423a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.877564:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f27abfb/0x8f4f7840b2e423a6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.877591:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789181616.878468:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789181616.878478:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f27abfb/0x8f4f7840b2e423a6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181616.878495:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1baab9200 already unused, calling callback (ffffffffc152f9b0) 00010000:00010000:2.0:1789181616.878500:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f27abfb/0x8f4f7840b2e423a6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181616.878511:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f27abfb/0x8f4f7840b2e423a6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181616.878530:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f27abfb/0x8f4f7840b2e423a6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181616.878538:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f27abfb/0x8f4f7840b2e423a6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181616.878557:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181616.878559:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181616.878561:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789181616.879463:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789181616.879473:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc3dfcb/0x8f4f7840b2e423ad lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.879487:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=509s v=(0 0) 00010000:00010000:1.0:1789181616.879491:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789181616.879496:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc3dfcb/0x8f4f7840b2e423ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.879509:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdc3dfcb/0x8f4f7840b2e423ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.879532:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc3dfcb/0x8f4f7840b2e423ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.879539:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc3dfcb/0x8f4f7840b2e423ad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181616.879558:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1789181616.879798:0:15109:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00010000:00010000:2.0:1789181616.879963:0:14412:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789181616.879971:0:14412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fdc3dfcb/0x8f4f7840b2e423ad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181616.879980:0:14412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1baab9a00 already unused, calling callback (ffffffffc152f9b0) 00010000:00010000:2.0:1789181616.880044:0:14412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc3dfcb/0x8f4f7840b2e423ad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181616.880055:0:14412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc3dfcb/0x8f4f7840b2e423ad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181616.880077:0:14412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fdc3dfcb/0x8f4f7840b2e423ad lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181616.880084:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdc3dfcb/0x8f4f7840b2e423ad lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181616.880099:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181616.880101:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181616.880103:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181616.880981:0:15109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c01c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14446:x1876092510109440:12345-0@lo:5:osp-pre-0-0.0 Request processed in 105765us (107299us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181616.881058:0:15109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789181616.881156:0:14446:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c01c4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14446:1876092510109440:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1789181616.881171:0:14446:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:2.0:1789181616.881211:0:14446:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0833d3100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14446:1876092510109568:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1789181616.881246:0:14446:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181616.881294:0:14446:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc18985de40 going to sleep for 11 seconds 00000100:00100000:1.0:1789181616.881777:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510109568 00000100:00100000:1.0:1789181616.881783:0:15106:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510109568 00000100:00100000:1.0:1789181616.881836:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789181616.881853:0:15106:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0833d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14446:x1876092510109568:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1789181616.881893:0:15106:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:2.0:1789181616.892835:0:15106:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0833d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14446:x1876092510109568:12345-0@lo:5:osp-pre-0-0.0 Request processed in 10982us (11579us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1789181616.893459:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789181616.893525:0:14446:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc0833d3100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14446:1876092510109568:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1789181616.893542:0:14446:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:2.0:1789181617.342560:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789181617.614680:0:15825:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789181617.614684:0:15825:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1789181617.614804:0:15825:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9dc1babd7800 00000020:01000004:0.0:1789181617.614822:0:15825:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1789181617.614836:0:15825:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1789181617.614849:0:15825:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9dc189d13380) 00000020:00000080:0.0:1789181617.614865:0:15825:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1789181617.642150:0:15825:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1789181617.642579:0:15825:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1789181617.643983:0:15825:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1789181617.644229:0:15825:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1789181617.644472:0:15825:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1789181617.645758:0:15825:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 275: rc = 0 00100000:10000000:1.0:1789181617.646053:0:15825:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 275: rc = 0 00100000:10000000:1.0:1789181617.646520:0:15825:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 275: rc = 0 00100000:10000000:1.0:1789181617.647110:0:15825:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 277: rc = 0 00100000:10000000:1.0:1789181617.647541:0:15825:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 277: rc = 0 00100000:10000000:1.0:1789181617.647789:0:15825:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 277: rc = 0 00100000:10000000:1.0:1789181617.648105:0:15825:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 277: rc = 0 00100000:10000000:0.0:1789181617.648665:0:15825:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 277: rc = 0 00100000:10000000:0.0:1789181617.649057:0:15825:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 277: rc = 0 00000020:00000080:0.0:1789181617.649685:0:15825:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1789181617.649697:0:15825:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789181617.649708:0:15825:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x8f4f7840b2e423bb 00000020:01000004:0.0:1789181617.649717:0:15825:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:0.0:1789181617.649739:0:15825:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.132@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1789181617.649743:0:15825:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.132@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1789181617.649756:0:15825:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1789181617.649776:0:15825:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:0.0:1789181617.649781:0:15825:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.132@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1789181617.659821:0:15825:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.132@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789181617.659868:0:15825:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.132@tcp, index=0001, flags=0x20002 00000020:01000004:0.0:1789181617.659873:0:15825:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789181617.659875:0:15825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789181617.659876:0:15825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789181617.659877:0:15825:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789181617.659878:0:15825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789181617.659879:0:15825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789181617.659881:0:15825:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789181617.659883:0:15825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789181617.659884:0:15825:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789181617.659887:0:15825:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:0.0:1789181617.659889:0:15825:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789181617.659891:0:15825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789181617.659892:0:15825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789181617.659893:0:15825:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789181617.659894:0:15825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789181617.659895:0:15825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789181617.659896:0:15825:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789181617.659897:0:15825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789181617.659898:0:15825:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789181617.659923:0:15825:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1789181617.659944:0:15825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c01c6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:15825:1876092510109696:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789181617.660012:0:15825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181617.660121:0:15825:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc18872a540 going to sleep for 11 seconds 00000100:00100000:2.0:1789181617.660168:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510109696 00000100:00100000:2.0:1789181617.660176:0:14418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510109696 00000100:00100000:2.0:1789181617.660230:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789181617.660240:0:14418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c1ce3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:486954f1-c2e6-402a-b3c8-096af476560c+16:15825:x1876092510109696:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789181617.660294:0:14418:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1789181617.660298:0:14418:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1789181617.660302:0:14418:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1789181617.697302:0:15825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c01c6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:15825:1876092510109696:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789181617.697325:0:15825:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1789181617.697328:0:15825:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789181617.697341:0:15825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789181617.697343:0:15825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789181617.697345:0:15825:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789181617.697346:0:15825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789181617.697347:0:15825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789181617.697349:0:15825:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789181617.697351:0:15825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789181617.697352:0:15825:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789181617.697375:0:15825:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9dc1babd7800 from lustre-OST0001 10000000:01000000:1.0:1789181617.697403:0:15825:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1789181617.697405:0:15825:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1789181617.697413:0:15825:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9dc18981b380 local copy 00010000:00010000:1.0:1789181617.697423:0:15825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1f000/0x8f4f7840b2e42161 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e42168 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181617.697750:0:14418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c1ce3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:486954f1-c2e6-402a-b3c8-096af476560c+16:15825:x1876092510109696:12345-0@lo:253:mount.lustre.0 Request processed in 37508us (37734us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181617.697761:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789181617.698420:0:15825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6e5c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:15825:1876092510109824:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789181617.698475:0:15825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181617.699788:0:15825:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc187aff180 going to sleep for 11 seconds 00000100:00100000:2.0:1789181617.701959:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510109824 00000100:00100000:2.0:1789181617.701973:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510109824 00000100:00100000:2.0:1789181617.702106:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789181617.702117:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c1ce2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:486954f1-c2e6-402a-b3c8-096af476560c+16:15825:x1876092510109824:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789181617.702486:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c1ce2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:486954f1-c2e6-402a-b3c8-096af476560c+16:15825:x1876092510109824:12345-0@lo:501:mount.lustre.0 Request processed in 370us (4010us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789181617.702494:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789181617.703152:0:15825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6e5c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:15825:1876092510109824:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789181617.703178:0:15825:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.132@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789181617.703371:0:15825:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.132@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789181617.703380:0:15825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1f000/0x8f4f7840b2e42161 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e42168 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181617.703399:0:15825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1f000/0x8f4f7840b2e42161 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e42168 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789181617.703426:0:15825:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9dc1babd7800 10000000:01000000:1.0:1789181617.703432:0:15825:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789181617.703437:0:15825:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1789181617.703440:0:15825:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789181617.703444:0:15825:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1789181617.703447:0:15825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1789181617.703479:0:15825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc1baab9c00/0x8f4f7840b2e423c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181617.703487:0:15825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.132@tcp lock: ffff9dc1baab9c00/0x8f4f7840b2e423c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181617.703497:0:15825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.132@tcp lock: ffff9dc1baab9c00/0x8f4f7840b2e423c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181617.703516:0:15825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6e5c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:15825:1876092510109952:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789181617.703556:0:15825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181617.707216:0:15825:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc187aff180 going to sleep for 11 seconds 00000100:00100000:2.0:1789181617.707438:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510109952 00000100:00100000:2.0:1789181617.707447:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510109952 00000100:00100000:2.0:1789181617.707487:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789181617.707495:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c1ce2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:486954f1-c2e6-402a-b3c8-096af476560c+16:15825:x1876092510109952:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789181617.707510:0:14417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181617.707529:0:14417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc1c0258800/0x8f4f7840b2e423c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f4f7840b2e423c2 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181617.707555:0:14417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc1c0258800/0x8f4f7840b2e423c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f4f7840b2e423c2 expref: 17 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181617.707565:0:14417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc1c0258800/0x8f4f7840b2e423c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e423c2 expref: 17 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181617.707574:0:14417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1c0258800, rc 0) 00000100:00100000:2.0:1789181617.707628:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c1ce2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:486954f1-c2e6-402a-b3c8-096af476560c+17:15825:x1876092510109952:12345-0@lo:101:mount.lustre.0 Request processed in 134us (4071us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181617.707635:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789181617.708304:0:15825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6e5c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:15825:1876092510109952:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789181617.708324:0:15825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.132@tcp lock: ffff9dc1baab9c00/0x8f4f7840b2e423c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e423c9 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181617.708366:0:15825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.132@tcp lock: ffff9dc1baab9c00/0x8f4f7840b2e423c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f4f7840b2e423c9 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789181617.709276:0:15825:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1789181617.711243:0:15825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789181617.711537:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1789181617.711577:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1789181617.711603:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1789181617.711640:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1789181617.711669:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1789181617.711695:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1789181617.711745:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1789181617.711752:0:15825:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1789181617.712063:0:15825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1988c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:15825:1876092510110080:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789181617.712125:0:15825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181617.712294:0:15825:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1ba4b99c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789181617.713214:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510110080 00000100:00100000:1.0:1789181617.713224:0:14418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510110080 00000100:00100000:1.0:1789181617.713282:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789181617.713291:0:14418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c1ce3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:486954f1-c2e6-402a-b3c8-096af476560c+17:15825:x1876092510110080:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789181617.713802:0:14418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c1ce3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:486954f1-c2e6-402a-b3c8-096af476560c+17:15825:x1876092510110080:12345-0@lo:501:mount.lustre.0 Request processed in 498us (1662us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181617.713810:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789181617.713943:0:15825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1988c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:15825:1876092510110080:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789181617.713988:0:15825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0833d2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:15825:1876092510110208:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789181617.714039:0:15825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181617.714060:0:15825:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc188ad70c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789181617.714131:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510110208 00000100:00100000:3.0:1789181617.714136:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510110208 00000100:00100000:3.0:1789181617.714175:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789181617.714182:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c1ce3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:486954f1-c2e6-402a-b3c8-096af476560c+17:15825:x1876092510110208:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789181617.714504:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c1ce3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:486954f1-c2e6-402a-b3c8-096af476560c+17:15825:x1876092510110208:12345-0@lo:503:mount.lustre.0 Request processed in 322us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181617.714511:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789181617.714662:0:15825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc0833d2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:15825:1876092510110208:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789181617.715252:0:15825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789181617.715319:0:15825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0833d2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:15825:1876092510110336:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789181617.715390:0:15825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181617.715413:0:15825:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc188ad70c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789181617.715743:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510110336 00000100:00100000:3.0:1789181617.715749:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510110336 00000100:00100000:3.0:1789181617.715774:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789181617.715782:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c1ce0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:486954f1-c2e6-402a-b3c8-096af476560c+17:15825:x1876092510110336:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789181617.716007:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c1ce0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:486954f1-c2e6-402a-b3c8-096af476560c+17:15825:x1876092510110336:12345-0@lo:502:mount.lustre.0 Request processed in 225us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181617.716015:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789181617.716167:0:15825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc0833d2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:15825:1876092510110336:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789181617.716410:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1789181617.716455:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1789181617.716486:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1789181617.716530:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1789181617.716565:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1789181617.716595:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1789181617.716638:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1789181617.716675:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1789181617.716723:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:2.0:1789181617.716752:0:15825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0833d2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:15825:1876092510110464:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789181617.716804:0:15825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181617.717194:0:15825:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc188ad70c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789181617.717638:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510110464 00000100:00100000:1.0:1789181617.717645:0:14418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510110464 00000100:00100000:1.0:1789181617.717675:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789181617.717683:0:14418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c1ce1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:486954f1-c2e6-402a-b3c8-096af476560c+17:15825:x1876092510110464:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789181617.718201:0:14418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c1ce1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:486954f1-c2e6-402a-b3c8-096af476560c+17:15825:x1876092510110464:12345-0@lo:502:mount.lustre.0 Request processed in 517us (1394us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181617.718209:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789181617.721105:0:15825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc0833d2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:15825:1876092510110464:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789181617.721362:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1789181617.721378:0:15825:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:0.0:1789181617.742652:0:15826:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789181617.742664:0:15826:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1789181617.742671:0:15826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789181617.742673:0:15826:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1789181617.742684:0:15826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789181617.742700:0:15826:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9dc189d10000) 00000020:00000080:0.0:1789181617.742721:0:15826:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:0.0:1789181617.742728:0:15826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789181617.742803:0:15826:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dc1babd7800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1789181617.742811:0:15826:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789181617.742818:0:15826:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x8f4f7840b2e423d7 00010000:00010000:2.0:1789181617.747596:0:15826:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:2.0:1789181617.748041:0:15826:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:2.0:1789181617.750971:0:15826:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1789181617.767378:0:15826:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1789181617.767393:0:15826:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789181617.767399:0:15826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789181617.767401:0:15826:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1789181617.767404:0:15826:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789181617.767407:0:15826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789181617.767409:0:15826:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789181617.767412:0:15826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789181617.767413:0:15826:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789181617.767415:0:15826:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789181617.767417:0:15826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789181617.767419:0:15826:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789181617.767421:0:15826:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789181617.767423:0:15826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789181617.767424:0:15826:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789181617.767428:0:15826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1789181617.767489:0:15826:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789181617.767492:0:15826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789181617.767493:0:15826:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789181617.767497:0:15826:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1789181617.767715:0:15825:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1789181617.767743:0:15825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.132@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1789181617.767766:0:15825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc1baab9c00/0x8f4f7840b2e423c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e423c9 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181617.767777:0:15825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.132@tcp lock: ffff9dc1baab9c00/0x8f4f7840b2e423c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e423c9 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789181617.767784:0:15825:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9dc1babd7800 from 1 10000000:01000000:3.0:1789181617.767787:0:15825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789181617.767844:0:15825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1e200/0x8f4f7840b2e423de lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181617.767869:0:15825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1e200/0x8f4f7840b2e423de lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181617.767880:0:15825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1e200/0x8f4f7840b2e423de lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181617.767904:0:15825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1988c2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:15825:1876092510110592:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789181617.767966:0:15825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181617.768012:0:15825:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1ba4b9c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789181617.768133:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510110592 00000100:00100000:2.0:1789181617.768151:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510110592 00000100:00100000:2.0:1789181617.768208:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789181617.768216:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c1ce2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:486954f1-c2e6-402a-b3c8-096af476560c+17:15825:x1876092510110592:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789181617.768228:0:14416:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181617.768239:0:14416:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc1c0258400/0x8f4f7840b2e423e5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f4f7840b2e423de expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181617.768262:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc1c0258400/0x8f4f7840b2e423e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f4f7840b2e423de expref: 18 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181617.768273:0:14416:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc1c0258400/0x8f4f7840b2e423e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e423de expref: 18 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181617.768297:0:14416:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1c0258400, rc 0) 00000100:00100000:2.0:1789181617.768350:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c1ce2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:486954f1-c2e6-402a-b3c8-096af476560c+18:15825:x1876092510110592:12345-0@lo:101:mount.lustre.0 Request processed in 135us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181617.768361:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789181617.768676:0:15825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1988c2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:15825:1876092510110592:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789181617.768692:0:15825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1e200/0x8f4f7840b2e423de lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e423e5 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181617.768702:0:15825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1e200/0x8f4f7840b2e423de lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f4f7840b2e423e5 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789181617.769546:0:15825:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1789181617.770606:0:15825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789181617.771003:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1789181617.771049:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1789181617.771111:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1789181617.771120:0:15825:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1789181617.771441:0:15825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1988c2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:15825:1876092510110720:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789181617.771504:0:15825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181617.771619:0:15825:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1ba4b9c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789181617.771674:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510110720 00000100:00100000:2.0:1789181617.771681:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510110720 00000100:00100000:2.0:1789181617.771760:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789181617.771780:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c1ce0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:486954f1-c2e6-402a-b3c8-096af476560c+18:15825:x1876092510110720:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789181617.772026:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c1ce0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:486954f1-c2e6-402a-b3c8-096af476560c+18:15825:x1876092510110720:12345-0@lo:501:mount.lustre.0 Request processed in 248us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181617.772035:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789181617.773742:0:15825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1988c2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:15825:1876092510110720:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789181617.773812:0:15825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6e5c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:15825:1876092510110848:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789181617.773936:0:15825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181617.773975:0:15825:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1ba42f840 going to sleep for 11 seconds 00000100:00100000:3.0:1789181617.774243:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510110848 00000100:00100000:3.0:1789181617.774250:0:14418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510110848 00000100:00100000:3.0:1789181617.774316:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789181617.774325:0:14418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bba0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:486954f1-c2e6-402a-b3c8-096af476560c+18:15825:x1876092510110848:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789181617.774684:0:14418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bba0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:486954f1-c2e6-402a-b3c8-096af476560c+18:15825:x1876092510110848:12345-0@lo:503:mount.lustre.0 Request processed in 361us (748us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181617.774692:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789181617.774759:0:15825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6e5c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:15825:1876092510110848:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789181617.775290:0:15825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789181617.775391:0:15825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6e5c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:15825:1876092510110976:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789181617.775433:0:15825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181617.775475:0:15825:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc0821f4240 going to sleep for 11 seconds 00000100:00100000:2.0:1789181617.776639:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510110976 00000100:00100000:2.0:1789181617.776648:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510110976 00000100:00100000:2.0:1789181617.776696:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789181617.776704:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bba0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:486954f1-c2e6-402a-b3c8-096af476560c+18:15825:x1876092510110976:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789181617.777035:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bba0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:486954f1-c2e6-402a-b3c8-096af476560c+18:15825:x1876092510110976:12345-0@lo:502:mount.lustre.0 Request processed in 330us (1600us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181617.777047:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789181617.778844:0:15825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6e5c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:15825:1876092510110976:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789181617.779170:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1789181617.779236:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1789181617.779301:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1789181617.779365:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1789181617.779402:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1789181617.779451:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1789181617.779489:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1789181617.779525:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1789181617.779563:0:15825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6e5c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:15825:1876092510111104:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789181617.779625:0:15825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181617.779670:0:15825:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc0821f4240 going to sleep for 11 seconds 00000100:00100000:2.0:1789181617.779821:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510111104 00000100:00100000:2.0:1789181617.780424:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510111104 00000100:00100000:2.0:1789181617.780479:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789181617.780489:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bba0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:486954f1-c2e6-402a-b3c8-096af476560c+18:15825:x1876092510111104:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789181617.780699:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bba0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:486954f1-c2e6-402a-b3c8-096af476560c+18:15825:x1876092510111104:12345-0@lo:502:mount.lustre.0 Request processed in 211us (1073us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181617.780707:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789181617.786567:0:15825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6e5c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:15825:1876092510111104:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789181617.786911:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1789181617.786929:0:15825:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1789181617.788092:0:15830:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789181617.788102:0:15830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789181617.788105:0:15830:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789181617.788112:0:15830:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dc1babd7800 00000020:00000080:1.0:1789181617.788114:0:15830:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789181617.788121:0:15830:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789181617.788124:0:15830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789181617.788125:0:15830:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789181617.788128:0:15830:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789181617.788130:0:15830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789181617.788131:0:15830:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789181617.788134:0:15830:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dc1babd7800 00000020:00000080:1.0:1789181617.788136:0:15830:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789181617.788201:0:15830:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789181617.788211:0:15830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789181617.788212:0:15830:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789181617.788215:0:15830:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789181617.788217:0:15830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789181617.788218:0:15830:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789181617.788221:0:15830:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9dc1babd7800 00000020:00000080:1.0:1789181617.788224:0:15830:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789181617.788258:0:15830:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789181617.788261:0:15830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789181617.788262:0:15830:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1789181617.788265:0:15830:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1789181617.788477:0:15825:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1789181617.788502:0:15825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789181617.788522:0:15825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1e200/0x8f4f7840b2e423de lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e423e5 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181617.788534:0:15825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1e200/0x8f4f7840b2e423de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e423e5 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789181617.788588:0:15825:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789181617.788591:0:15825:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9dc1babd7800 10000000:01000000:0.0:1789181617.788594:0:15825:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9dc1babd7800 10000000:01000000:0.0:1789181617.788597:0:15825:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789181617.788603:0:15825:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9dc1babd7800 from 1 10000000:01000000:0.0:1789181617.788605:0:15825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789181617.788637:0:15825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc189891c00/0x8f4f7840b2e423ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181617.788646:0:15825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.132@tcp lock: ffff9dc189891c00/0x8f4f7840b2e423ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181617.788656:0:15825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.132@tcp lock: ffff9dc189891c00/0x8f4f7840b2e423ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181617.788677:0:15825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c01c7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:15825:1876092510111232:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789181617.788741:0:15825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181617.788785:0:15825:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc188bfd540 going to sleep for 11 seconds 00000100:00100000:1.0:1789181617.788960:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510111232 00000100:00100000:1.0:1789181617.788967:0:14418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510111232 00000100:00100000:1.0:1789181617.789013:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789181617.789022:0:14418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bba0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:486954f1-c2e6-402a-b3c8-096af476560c+18:15825:x1876092510111232:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789181617.789035:0:14418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181617.789046:0:14418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc1baab8a00/0x8f4f7840b2e423f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f4f7840b2e423ec expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181617.789069:0:14418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc1baab8a00/0x8f4f7840b2e423f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f4f7840b2e423ec expref: 19 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181617.789080:0:14418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc1baab8a00/0x8f4f7840b2e423f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e423ec expref: 19 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181617.789088:0:14418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1baab8a00, rc 0) 00000100:00100000:1.0:1789181617.789130:0:14418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bba0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:486954f1-c2e6-402a-b3c8-096af476560c+19:15825:x1876092510111232:12345-0@lo:101:mount.lustre.0 Request processed in 109us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181617.789146:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789181617.789453:0:15825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c01c7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:15825:1876092510111232:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789181617.789467:0:15825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.132@tcp lock: ffff9dc189891c00/0x8f4f7840b2e423ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e423f3 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181617.789476:0:15825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.132@tcp lock: ffff9dc189891c00/0x8f4f7840b2e423ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f4f7840b2e423f3 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181617.791412:0:3302:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789181602/real 1789181602] req@ffff9dc0833d0700 x1876092510104576/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789181617 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181617.791451:0:3302:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9dc0833d0700 x1876092510104576/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789181617 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789181617.791467:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9dc1992d7800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789181617.791482:0:3302:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789181617.791487:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc0833d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1876092510104576:0@lo:8:kworker.0 00000100:00080000:1.0:1789181617.791547:0:42:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789181617.791551:0:42:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789181617.791554:0:42:0:(import.c:65:import_set_state_nolock()) ffff9dc1992d7800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789181617.791558:0:42:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 494 00000100:00080000:1.0:1789181617.791563:0:42:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789181617.791573:0:42:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9dc1992d7800 using connection 192.168.204.132@tcp/0@lo 00000100:00100000:1.0:1789181617.791591:0:42:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc1b6e5ea00 x1876092510111488/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789181617.791631:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789181617.791641:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6e5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1876092510111744:0@lo:400:kworker.0 00000100:00100000:1.0:1789181617.791697:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181617.791737:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6e5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1876092510111488:0@lo:8:kworker.0 00000100:00100000:1.0:1789181617.791763:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181617.791811:0:15109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510111488 00000100:00100000:1.0:1789181617.791818:0:15109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510111488 00000100:00100000:2.0:1789181617.792650:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6e5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876092510111616:0@lo:400:kworker.0 00000100:00100000:2.0:1789181617.792687:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181617.792718:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789181617.792724:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6e5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876092510111360:0@lo:400:kworker.0 00000100:00100000:2.0:1789181617.792745:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181617.792943:0:15109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510111360 00000100:00100000:1.0:1789181617.792949:0:15109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510111360 00000100:00100000:1.0:1789181617.792976:0:15109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789181617.792984:0:15109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0833d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3306:x1876092510111360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181617.793047:0:15109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0833d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3306:x1876092510111360:12345-0@lo:400:kworker.0 Request processed in 64us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181617.793054:0:15109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789181617.793072:0:15109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789181617.793077:0:15109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6e5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3302:x1876092510111488:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1789181617.793122:0:15109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6e5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3302:x1876092510111488:12345-0@lo:8:kworker.0 Request processed in 44us (1357us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789181617.793128:0:15109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789181617.793535:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510111744 00000100:00100000:3.0:1789181617.793540:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510111744 00000100:00100000:3.0:1789181617.793567:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510111616 00000100:00100000:3.0:1789181617.793570:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510111616 00000100:00100000:3.0:1789181617.793591:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789181617.793598:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6e5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876092510111744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181617.793642:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6e5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876092510111744:12345-0@lo:400:kworker.0 Request processed in 44us (1944us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181617.793648:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789181617.793660:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789181617.793667:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0833d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876092510111616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181617.793693:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0833d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876092510111616:12345-0@lo:400:kworker.0 Request processed in 27us (1005us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181617.793699:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1789181617.793755:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dc1b6e5ce00 x1876092510111744/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181633 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181617.793778:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6e5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1876092510111744:0@lo:400:kworker.0 00000100:00100000:1.0:1789181617.794846:0:3302:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789181617.794856:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9dc1992d7800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789181617.794862:0:3302:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789181617.794867:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6e5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1876092510111488:0@lo:8:kworker.0 00000100:00100000:1.0:1789181617.795429:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6e5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876092510111360:0@lo:400:kworker.0 00010000:00080000:1.0:1789181617.795447:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dc1b6e5c000 x1876092510111616/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181633 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789181617.795459:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6e5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876092510111616:0@lo:400:kworker.0 00000040:00080000:0.0:1789181617.795577:0:15825:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:0.0:1789181617.796084:0:15825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789181617.796391:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1789181617.796451:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1789181617.796507:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1789181617.796558:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1789181617.796597:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1789181617.796645:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1789181617.796679:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1789181617.796709:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1789181617.796769:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1789181617.796830:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1789181617.796865:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1789181617.796912:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1789181617.796947:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1789181617.796980:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1789181617.797025:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1789181617.797056:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1789181617.797085:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1789181617.797133:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1789181617.797170:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1789181617.797204:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1789181617.797250:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1789181617.797283:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1789181617.797311:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1789181617.797380:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1789181617.797707:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1789181617.797756:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1789181617.797868:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1789181617.797897:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1789181617.797923:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1789181617.797958:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:0.0:1789181617.797986:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:0.0:1789181617.798011:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:0.0:1789181617.798037:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:0.0:1789181617.798072:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:0.0:1789181617.798112:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:0.0:1789181617.798157:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:0.0:1789181617.798186:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:0.0:1789181617.798260:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:0.0:1789181617.798266:0:15825:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:0.0:1789181617.800003:0:15825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c01c7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:15825:1876092510111872:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789181617.800065:0:15825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181617.810942:0:15825:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc188bfd540 going to sleep for 11 seconds 00000100:00100000:1.0:1789181617.811034:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510111872 00000100:00100000:1.0:1789181617.811043:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510111872 00000100:00100000:1.0:1789181617.811099:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789181617.811110:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bba0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:486954f1-c2e6-402a-b3c8-096af476560c+19:15825:x1876092510111872:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789181617.811537:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bba0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:486954f1-c2e6-402a-b3c8-096af476560c+19:15825:x1876092510111872:12345-0@lo:501:mount.lustre.0 Request processed in 429us (11471us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181617.811545:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789181617.813568:0:15825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c01c7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:15825:1876092510111872:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789181617.813628:0:15825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c01c7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:15825:1876092510112000:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789181617.813694:0:15825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181617.813732:0:15825:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc188bfd540 going to sleep for 11 seconds 00000100:00100000:0.0:1789181617.814492:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510112000 00000100:00100000:0.0:1789181617.814502:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510112000 00000100:00100000:0.0:1789181617.814556:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789181617.814566:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bba0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:486954f1-c2e6-402a-b3c8-096af476560c+19:15825:x1876092510112000:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789181617.815032:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bba0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:486954f1-c2e6-402a-b3c8-096af476560c+19:15825:x1876092510112000:12345-0@lo:503:mount.lustre.0 Request processed in 467us (1336us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181617.815042:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789181617.820950:0:15825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c01c7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:15825:1876092510112000:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789181617.821692:0:15825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789181617.821890:0:15825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b6e5c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:15825:1876092510112128:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789181617.821965:0:15825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181617.822911:0:15825:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc184cb30c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789181617.823891:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510112128 00000100:00100000:0.0:1789181617.823902:0:14418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510112128 00000100:00100000:1.0:1789181617.830981:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789181617.830995:0:14418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bba0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:486954f1-c2e6-402a-b3c8-096af476560c+19:15825:x1876092510112128:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789181617.831413:0:14418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bba0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:486954f1-c2e6-402a-b3c8-096af476560c+19:15825:x1876092510112128:12345-0@lo:502:mount.lustre.0 Request processed in 421us (9448us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181617.831422:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789181617.831532:0:15825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b6e5c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:15825:1876092510112128:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789181617.832025:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1789181617.832076:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1789181617.832106:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1789181617.832175:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1789181617.832216:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1789181617.832260:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1789181617.832294:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1789181617.832354:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1789181617.832407:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1789181617.832443:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1789181617.832478:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1789181617.832525:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1789181617.832561:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1789181617.832611:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1789181617.832661:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1789181617.832699:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1789181617.832733:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1789181617.832897:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1789181617.832932:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1789181617.832960:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1789181617.833003:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1789181617.833038:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1789181617.833068:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1789181617.833116:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1789181617.833152:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1789181617.833185:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1789181617.833248:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1789181617.833285:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1789181617.833319:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1789181617.834022:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1789181617.834062:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1789181617.834241:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1789181617.834267:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1789181617.834303:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1789181617.834525:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1789181617.834574:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1789181617.834600:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1789181617.834624:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1789181617.834657:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1789181617.834682:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1789181617.834724:0:15825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0833d2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:15825:1876092510112256:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789181617.834811:0:15825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181617.834916:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510112256 00000100:00100000:0.0:1789181617.834923:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510112256 00000100:00100000:0.0:1789181617.835000:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789181617.835010:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bba0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:486954f1-c2e6-402a-b3c8-096af476560c+19:15825:x1876092510112256:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789181617.835192:0:15825:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc190660300 going to sleep for 11 seconds 00000100:00100000:0.0:1789181617.835248:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bba0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:486954f1-c2e6-402a-b3c8-096af476560c+19:15825:x1876092510112256:12345-0@lo:502:mount.lustre.0 Request processed in 239us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181617.835265:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789181617.835271:0:15825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc0833d2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:15825:1876092510112256:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789181617.835351:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1789181617.835361:0:15825:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1789181617.836272:0:15835:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1789181617.836287:0:15835:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9dc1879d19c0) 00000020:00000080:1.0:1789181617.836307:0:15835:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:1.0:1789181617.836699:0:15835:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dc1babd7800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789181617.836704:0:15835:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dc1babd7800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789181617.836707:0:15835:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dc1babd7800 3 00010000:00080000:1.0:1789181617.836735:0:15835:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dc0822b1800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.132@tcp at head 00010000:00010000:2.0:1789181617.838954:0:15835:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:2.0:1789181617.839225:0:15835:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1789181617.839265:0:15835:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789181617.839283:0:15835:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x8f4f7840b2e42401 00000100:00080000:2.0:1789181617.839294:0:15835:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789181617.839305:0:15835:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9dc0822b1800 using connection 192.168.204.132@tcp/0@lo 00000100:00100000:2.0:1789181617.839628:0:15835:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc0833d1500 x1876092510112384/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789181617.839649:0:15835:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789181617.839977:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0833d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3302:1876092510112384:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789181617.840043:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181617.840177:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510112384 00000100:00100000:3.0:1789181617.840184:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510112384 00000100:00100000:3.0:1789181617.840223:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789181617.840231:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6e5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3302:x1876092510112384:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789181617.840254:0:14424:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 510 last 0 00000020:00000080:3.0:1789181617.840299:0:14424:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x8f4f7840b2e42408 00000004:00100000:3.0:1789181617.840313:0:14424:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789181617.840364:0:14424:0:(import.c:65:import_set_state_nolock()) ffff9dc1b66e1000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789181617.840416:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6e5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876092510112384:12345-0@lo:38:llog_process_th.0 Request processed in 185us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181617.840424:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789181617.840461:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dc0833d1500 x1876092510112384/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789181627 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789181617.840472:0:3302:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789181617.840479:0:3302:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1789181617.840487:0:3302:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789181617.840491:0:3302:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789181617.840494:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9dc0822b1800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789181617.840500:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc0833d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3302:1876092510112384:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1789181617.840729:0:15835:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:3.0:1789181617.845950:0:15825:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1789181617.845991:0:15825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789181617.846013:0:15825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc189891c00/0x8f4f7840b2e423ec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e423f3 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181617.846026:0:15825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.132@tcp lock: ffff9dc189891c00/0x8f4f7840b2e423ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e423f3 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789181617.846086:0:15825:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789181617.846088:0:15825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789181617.846090:0:15825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789181617.846091:0:15825:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789181617.846092:0:15825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789181617.846093:0:15825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789181617.846094:0:15825:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789181617.846096:0:15825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789181617.846098:0:15825:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789181617.846102:0:15825:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1789181617.846104:0:15825:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789181617.846105:0:15825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789181617.846106:0:15825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789181617.846107:0:15825:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789181617.846108:0:15825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789181617.846109:0:15825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789181617.846110:0:15825:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789181617.846111:0:15825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789181617.846112:0:15825:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789181617.846138:0:15825:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789181617.846159:0:15825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1988c3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:15825:1876092510112512:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789181617.846231:0:15825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181617.846279:0:15825:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1879a6a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789181617.846437:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510112512 00000100:00100000:1.0:1789181617.846446:0:14418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510112512 00000100:00100000:1.0:1789181617.846498:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789181617.846507:0:14418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bba0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:486954f1-c2e6-402a-b3c8-096af476560c+19:15825:x1876092510112512:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789181617.846545:0:14418:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1789181617.846560:0:14418:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789181617.910114:0:14418:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789181617.910140:0:14418:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1789181617.910272:0:14439:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789181617.910277:0:14439:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789181617.910299:0:14439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dc1bfa1e400/0x8f4f7840b2e4240f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181617.910318:0:14439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dc1bfa1f200/0x8f4f7840b2e422e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e422db expref: 19 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181617.910326:0:14439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9dc1bfa1e400/0x8f4f7840b2e4240f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181617.910417:0:14439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dc1bfa1f200/0x8f4f7840b2e422e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8f4f7840b2e422db expref: 19 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181617.910431:0:14439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dc1bfa1f200/0x8f4f7840b2e422e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8f4f7840b2e422db expref: 19 pid: 14418 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181617.910445:0:14439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1988c3b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14439:1876092510112640:0@lo:104: 00000100:00100000:3.0:1789181617.910505:0:14439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181617.910546:0:14439:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1879a63c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789181617.910991:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510112640 00000100:00100000:2.0:1789181617.911000:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510112640 00000100:00100000:2.0:1789181617.911040:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789181617.911049:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1988c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:486954f1-c2e6-402a-b3c8-096af476560c+3:14439:x1876092510112640:12345-0@lo:104: 00010000:00010000:2.0:1789181617.911062:0:14406:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.132@tcp lock: ffff9dc189890e00/0x8f4f7840b2e422db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f4f7840b2e422e2 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181617.911117:0:14406:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789181617.911123:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1988c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:486954f1-c2e6-402a-b3c8-096af476560c+3:14439:x1876092510112640:12345-0@lo:104: Request processed in 76us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181617.911139:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1789181617.911162:0:14412:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789181617.911167:0:14412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.132@tcp lock: ffff9dc189890e00/0x8f4f7840b2e422db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f4f7840b2e422e2 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181617.911174:0:14412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc189890e00 already unused, calling callback (ffffffffc1b45c20) 10000000:00010000:2.0:1789181617.911178:0:14412:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.132@tcp lock: ffff9dc189890e00/0x8f4f7840b2e422db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8f4f7840b2e422e2 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181617.911186:0:14412:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.132@tcp lock: ffff9dc189890e00/0x8f4f7840b2e422db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8f4f7840b2e422e2 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789181617.911206:0:14412:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.132@tcp lock: ffff9dc189890e00/0x8f4f7840b2e422db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8f4f7840b2e422e2 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789181617.911212:0:14412:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789181617.911240:0:14412:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.132@tcp lock: ffff9dc189890e00/0x8f4f7840b2e422db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e422e2 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181617.911246:0:14412:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789181617.911262:0:14412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.132@tcp lock: ffff9dc189890e00/0x8f4f7840b2e422db lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e422e2 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181617.911269:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.132@tcp lock: ffff9dc189890e00/0x8f4f7840b2e422db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e422e2 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181617.911285:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181617.911287:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181617.911288:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789181617.911447:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0833d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:486954f1-c2e6-402a-b3c8-096af476560c:3304:1876092510112768:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789181617.911478:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181617.911527:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510112768 00000100:00100000:3.0:1789181617.911531:0:14409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510112768 00010000:00010000:3.0:1789181617.911548:0:14409:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dc1bfa1f200/0x8f4f7840b2e422e2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f4f7840b2e422db expref: 20 pid: 14418 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181617.911568:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789181617.911575:0:14409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1988c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:486954f1-c2e6-402a-b3c8-096af476560c+20:3304:x1876092510112768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789181617.911584:0:14409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789181617.911589:0:14409:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dc1bfa1f200/0x8f4f7840b2e422e2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f4f7840b2e422db expref: 20 pid: 14418 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181617.911599:0:14409:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dc1bfa1f200/0x8f4f7840b2e422e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8f4f7840b2e422db expref: 20 pid: 14418 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181617.911613:0:14409:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9dc1bfa1e400/0x8f4f7840b2e4240f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181617.911632:0:14409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc1bfa1e400/0x8f4f7840b2e4240f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789181617.911646:0:14409:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003978598s 00010000:00010000:3.0:1789181617.911651:0:14409:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dc1bfa1e400/0x8f4f7840b2e4240f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181617.911659:0:14409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dc1bfa1e400/0x8f4f7840b2e4240f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181617.911666:0:14409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dc1bfa1e400/0x8f4f7840b2e4240f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181617.911672:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dc1bfa1e400/0x8f4f7840b2e4240f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181617.911678:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1bfa1e400 already unused, calling callback (ffffffffc152f9b0) 00010000:00010000:3.0:1789181617.911681:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dc1bfa1e400/0x8f4f7840b2e4240f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181617.911689:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dc1bfa1e400/0x8f4f7840b2e4240f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181617.911696:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dc1bfa1e400/0x8f4f7840b2e4240f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181617.911706:0:14409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789181617.911736:0:14409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1988c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:486954f1-c2e6-402a-b3c8-096af476560c+20:3304:x1876092510112768:12345-0@lo:103:ldlm_bl.0 Request processed in 162us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181617.911743:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789181617.911784:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc0833d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:486954f1-c2e6-402a-b3c8-096af476560c:3304:1876092510112768:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789181617.911837:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc1bfa1f200/0x8f4f7840b2e422e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8f4f7840b2e422db expref: 19 pid: 14418 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181617.911849:0:14439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1988c3b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14439:1876092510112640:0@lo:104: 00010000:00010000:3.0:1789181617.911861:0:14439:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9dc1bfa1e400/0x8f4f7840b2e4240f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181617.911870:0:14439:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9dc1bfa1e400/0x8f4f7840b2e4240f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181617.911877:0:14439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dc1bfa1e400/0x8f4f7840b2e4240f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181617.911882:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc1bfa1e400/0x8f4f7840b2e4240f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181617.944263:0:14418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bba0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:486954f1-c2e6-402a-b3c8-096af476560c+18:15825:x1876092510112512:12345-0@lo:253:mount.lustre.0 Request processed in 97748us (98022us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181617.944279:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789181617.944456:0:15825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1988c3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:486954f1-c2e6-402a-b3c8-096af476560c:15825:1876092510112512:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789181617.944489:0:15825:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1789181617.944493:0:15825:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789181617.944494:0:15825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789181617.944496:0:15825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789181617.944497:0:15825:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789181617.944498:0:15825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789181617.944500:0:15825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789181617.944501:0:15825:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789181617.944503:0:15825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789181617.944504:0:15825:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789181617.944518:0:15825:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789181617.955438:0:15825:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1789181617.956055:0:15825:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789181617.956692:0:15825:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1789181617.956930:0:15825:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1789181617.957946:0:15825:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1789181617.958701:0:15825:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1789181617.959764:0:15825:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1789181618.030995:0:15825:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1789181618.031004:0:15825:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1789181618.031038:0:15825:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789181618.031177:0:15825:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.132@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789181618.031196:0:15825:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1789181618.031225:0:15825:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1789181618.367705:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181619.391779:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789181619.648368:0:14420:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789181619.648376:0:14420:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9dc1ba454000 from 8 10000000:01000000:3.0:1789181619.648381:0:14420:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789181619.648425:0:14420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1e400/0x8f4f7840b2e42416 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181619.648437:0:14420:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1e400/0x8f4f7840b2e42416 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181619.648462:0:14420:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1e400/0x8f4f7840b2e42416 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181619.648490:0:14420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1988c3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:486954f1-c2e6-402a-b3c8-096af476560c:14420:1876092510112896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789181619.648563:0:14420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181619.648625:0:14420:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc190660780 going to sleep for 11 seconds 00000100:00100000:2.0:1789181619.648729:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510112896 00000100:00100000:2.0:1789181619.648739:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510112896 00000100:00100000:1.0:1789181619.648903:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789181619.648918:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bba0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:486954f1-c2e6-402a-b3c8-096af476560c+18:14420:x1876092510112896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789181619.648933:0:14417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181619.648948:0:14417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc1baab8e00/0x8f4f7840b2e4241d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f4f7840b2e42416 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181619.649046:0:14417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc1baab8e00/0x8f4f7840b2e4241d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f4f7840b2e42416 expref: 19 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181619.649058:0:14417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc1baab8e00/0x8f4f7840b2e4241d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e42416 expref: 19 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181619.649069:0:14417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1baab8e00, rc 0) 00000100:00100000:1.0:1789181619.649269:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bba0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:486954f1-c2e6-402a-b3c8-096af476560c+19:14420:x1876092510112896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 355us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181619.649276:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789181619.649450:0:14420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1988c3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:486954f1-c2e6-402a-b3c8-096af476560c:14420:1876092510112896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789181619.649468:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1e400/0x8f4f7840b2e42416 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e4241d expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181619.649477:0:14420:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1e400/0x8f4f7840b2e42416 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f4f7840b2e4241d expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181619.649537:0:14420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1988c3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:486954f1-c2e6-402a-b3c8-096af476560c:14420:1876092510113024:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789181619.649573:0:14420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181619.649611:0:14420:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc190660780 going to sleep for 11 seconds 00000100:00100000:2.0:1789181619.649717:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510113024 00000100:00100000:2.0:1789181619.649723:0:14418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510113024 00000100:00100000:2.0:1789181619.649771:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789181619.649779:0:14418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bba0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:486954f1-c2e6-402a-b3c8-096af476560c+19:14420:x1876092510113024:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789181619.649795:0:14418:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789181619.649891:0:14418:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789181619.649895:0:14418:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1789181619.653498:0:14418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bba0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:486954f1-c2e6-402a-b3c8-096af476560c+19:14420:x1876092510113024:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 3708us (3912us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181619.653514:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789181619.654253:0:14420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1988c3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:486954f1-c2e6-402a-b3c8-096af476560c:14420:1876092510113024:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789181619.654383:0:14420:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789181619.654397:0:14420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1e400/0x8f4f7840b2e42416 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e4241d expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181619.654410:0:14420:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1e400/0x8f4f7840b2e42416 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e4241d expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181620.418958:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789181621.358170:0:6718:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1789181621.358196:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00010000:00010000:1.0:1789181621.441557:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181622.270994:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789181622.271018:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0833d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876092510113152:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789181622.271083:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181622.271518:0:15111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510113152 00000100:00100000:3.0:1789181622.271526:0:15111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510113152 00000100:00100000:3.0:1789181622.271595:0:15111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789181622.271680:0:15111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0833d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876092510113152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789181622.271729:0:15111:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789181622.271781:0:15111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0833d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876092510113152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 179us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181622.271789:0:15111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789181622.271839:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1789181622.271866:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc0833d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876092510113152:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789181622.271930:0:14419:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789181622.465862:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789181623.297727:0:41:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789181623.297733:0:41:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789181623.297737:0:41:0:(import.c:65:import_set_state_nolock()) ffff9dc1992d7800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789181623.297753:0:41:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9dc1992d7800 using connection 192.168.204.132@tcp/0@lo 00000100:00100000:2.0:1789181623.297773:0:41:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dc0833d2300 x1876092510113536/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789181623.297827:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0833d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:486954f1-c2e6-402a-b3c8-096af476560c:3306:1876092510113280:0@lo:400:kworker.0 00000100:00100000:2.0:1789181623.297891:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181623.297941:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0833d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1876092510113920:0@lo:400:kworker.0 00000100:00100000:2.0:1789181623.297972:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181623.298011:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789181623.298017:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0833d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1876092510113792:0@lo:400:kworker.0 00000100:00100000:2.0:1789181623.298040:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181623.298069:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0833d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876092510113408:0@lo:400:kworker.0 00000100:00100000:2.0:1789181623.298095:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181623.298114:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789181623.298119:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0833d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876092510113664:0@lo:400:kworker.0 00000100:00100000:2.0:1789181623.298138:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181623.298163:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0833d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1876092510113536:0@lo:8:kworker.0 00000100:00100000:2.0:1789181623.298184:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181623.298214:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510113280 00000100:00100000:2.0:1789181623.298221:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510113280 00000100:00100000:2.0:1789181623.298261:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789181623.298270:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bbadb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:486954f1-c2e6-402a-b3c8-096af476560c+19:3306:x1876092510113280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181623.298315:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bbadb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:486954f1-c2e6-402a-b3c8-096af476560c+19:3306:x1876092510113280:12345-0@lo:400:kworker.0 Request processed in 47us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181623.298322:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789181623.298378:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510113920 00000100:00100000:2.0:1789181623.298382:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510113920 00000100:00100000:2.0:1789181623.298414:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510113792 00000100:00100000:2.0:1789181623.298416:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510113792 00000100:00100000:2.0:1789181623.298428:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510113664 00000100:00100000:2.0:1789181623.298431:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510113664 00000100:00100000:2.0:1789181623.298443:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789181623.298448:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0833d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876092510113920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181623.298479:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0833d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876092510113920:12345-0@lo:400:kworker.0 Request processed in 30us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181623.298484:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789181623.298503:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789181623.298509:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0833d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876092510113792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181623.298536:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0833d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876092510113792:12345-0@lo:400:kworker.0 Request processed in 27us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181623.298541:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789181623.298552:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789181623.298557:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c36dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876092510113664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181623.298584:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c36dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876092510113664:12345-0@lo:400:kworker.0 Request processed in 27us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181623.298590:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789181623.298611:0:15109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510113408 00000100:00100000:2.0:1789181623.298614:0:15109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510113408 00000100:00100000:2.0:1789181623.298637:0:15109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510113536 00000100:00100000:2.0:1789181623.298640:0:15109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510113536 00000100:00100000:2.0:1789181623.298650:0:15109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789181623.298656:0:15109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c36ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1876092510113408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181623.298698:0:15109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c36ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1876092510113408:12345-0@lo:400:kworker.0 Request processed in 41us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181623.298704:0:15109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789181623.298716:0:15109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789181623.298720:0:15109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c36ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3302:x1876092510113536:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1789181623.298742:0:15109:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 515 last 0 00000020:00000080:2.0:1789181623.298769:0:15109:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8f4f7840b2e42424 00002000:00100000:2.0:1789181623.298782:0:15109:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9dc1bfb9a000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1789181623.298786:0:15109:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1789181623.298789:0:15109:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789181623.304655:0:15109:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789181623.304707:0:15109:0:(import.c:65:import_set_state_nolock()) ffff9dc1bfb9f000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789181623.304805:0:15109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c36ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3302:x1876092510113536:12345-0@lo:8:kworker.0 Request processed in 6079us (6616us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181623.304816:0:15109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1789181623.304860:0:14419:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789181623.304900:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc0833d3480 x1876092510113664/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181639 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181623.304915:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc0833d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876092510113664:0@lo:400:kworker.0 00000100:00100000:2.0:1789181623.304930:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc0833d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876092510113408:0@lo:400:kworker.0 00010000:00080000:2.0:1789181623.304968:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc0833d1880 x1876092510113792/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181639 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181623.304978:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc0833d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1876092510113792:0@lo:400:kworker.0 00000100:00100000:2.0:1789181623.304988:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc0833d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:486954f1-c2e6-402a-b3c8-096af476560c:3306:1876092510113280:0@lo:400:kworker.0 00010000:00080000:2.0:1789181623.305000:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc0833d2d80 x1876092510113920/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789181639 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181623.305007:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc0833d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1876092510113920:0@lo:400:kworker.0 00010000:00080000:1.0:1789181623.306325:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc0833d2300 x1876092510113536/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789181643 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789181623.306374:0:3302:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1789181623.306383:0:3302:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789181623.306389:0:3302:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1789181623.306392:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9dc1992d7800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789181623.306403:0:3302:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789181623.306409:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc0833d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1876092510113536:0@lo:8:kworker.0 00000004:00080000:2.0:1789181623.308938:0:14448:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:2.0:1789181623.308972:0:14448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc19c36c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14448:1876092510114176:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1789181623.309045:0:14448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181623.311268:0:14448:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc18784a480 going to sleep for 11 seconds 00000004:00080000:2.0:1789181623.311294:0:14447:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789181623.311763:0:14447:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 515568431143ns, next at 0ns, rc = 0 00000100:00100000:2.0:1789181623.311792:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789181623.311817:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc19c36d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876092510114048:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789181623.311874:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181623.311920:0:15111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510114048 00000100:00100000:2.0:1789181623.311929:0:15111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510114048 00000100:00100000:2.0:1789181623.311980:0:15111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789181623.311989:0:15111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c36e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1876092510114048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789181623.312020:0:15111:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789181623.312059:0:15111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c36e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1876092510114048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181623.312066:0:15111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1789181623.312083:0:14419:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789181623.312369:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dc19c36d500 x1876092510114048/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789181639 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789181623.312403:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc19c36d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876092510114048:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789181623.312870:0:15109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510114176 00000100:00100000:2.0:1789181623.312877:0:15109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510114176 00000100:00100000:2.0:1789181623.312906:0:15109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789181623.312914:0:15109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c36d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14448:x1876092510114176:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1789181623.328842:0:15109:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1789181623.328854:0:15109:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:2.0:1789181623.328860:0:15109:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00002000:00010000:2.0:1789181623.353225:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789181623.353238:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4e78cf1/0x8f4f7840b2e4242b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.353257:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=515s v=(0 0) 00010000:00010000:2.0:1789181623.353261:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789181623.353274:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4e78cf1/0x8f4f7840b2e4242b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.353404:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4e78cf1/0x8f4f7840b2e4242b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.353416:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4e78cf1/0x8f4f7840b2e4242b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.353426:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d4e78cf1/0x8f4f7840b2e4242b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.353462:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789181623.354089:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789181623.354096:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000703a74d9/0x8f4f7840b2e42432 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.354106:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=515s v=(0 0) 00010000:00010000:2.0:1789181623.354110:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789181623.354115:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000703a74d9/0x8f4f7840b2e42432 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.354127:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000703a74d9/0x8f4f7840b2e42432 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.354136:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000703a74d9/0x8f4f7840b2e42432 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.354157:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000703a74d9/0x8f4f7840b2e42432 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.354178:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789181623.354246:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789181623.354255:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d4e78cf1/0x8f4f7840b2e4242b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181623.354267:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1c0259400 already unused, calling callback (ffffffffc152f9b0) 00010000:00010000:3.0:1789181623.354272:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4e78cf1/0x8f4f7840b2e4242b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181623.354282:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4e78cf1/0x8f4f7840b2e4242b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181623.354283:0:14412:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789181623.354303:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d4e78cf1/0x8f4f7840b2e4242b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181623.354311:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4e78cf1/0x8f4f7840b2e4242b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181623.354366:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181623.354369:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181623.354372:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789181623.354720:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789181623.354726:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000caefd5da/0x8f4f7840b2e42439 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.354736:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=515s v=(0 0) 00010000:00010000:2.0:1789181623.354740:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789181623.354744:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000caefd5da/0x8f4f7840b2e42439 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.354754:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000caefd5da/0x8f4f7840b2e42439 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.354834:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000caefd5da/0x8f4f7840b2e42439 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.354842:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000caefd5da/0x8f4f7840b2e42439 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.354862:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789181623.355283:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789181623.355289:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000caefd5da/0x8f4f7840b2e42439 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181623.355298:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1c0258600 already unused, calling callback (ffffffffc152f9b0) 00010000:00010000:3.0:1789181623.355302:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000caefd5da/0x8f4f7840b2e42439 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181623.355311:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000caefd5da/0x8f4f7840b2e42439 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181623.355323:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000caefd5da/0x8f4f7840b2e42439 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789181623.355425:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789181623.355432:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000617ae171/0x8f4f7840b2e42440 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181623.355445:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000caefd5da/0x8f4f7840b2e42439 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.355452:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=515s v=(0 0) 00010000:00010000:2.0:1789181623.355457:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789181623.355463:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000617ae171/0x8f4f7840b2e42440 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.355473:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000617ae171/0x8f4f7840b2e42440 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.355481:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000617ae171/0x8f4f7840b2e42440 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.355489:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000617ae171/0x8f4f7840b2e42440 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.355499:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789181623.355545:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789181623.355551:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000617ae171/0x8f4f7840b2e42440 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181623.355558:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1c0259800 already unused, calling callback (ffffffffc152f9b0) 00010000:00010000:3.0:1789181623.355567:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000617ae171/0x8f4f7840b2e42440 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181623.355575:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000617ae171/0x8f4f7840b2e42440 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181623.355587:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000617ae171/0x8f4f7840b2e42440 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181623.355594:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000617ae171/0x8f4f7840b2e42440 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181623.355608:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181623.355610:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181623.355612:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789181623.356049:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789181623.356055:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091461032/0x8f4f7840b2e42447 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.356063:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=515s v=(0 0) 00010000:00010000:2.0:1789181623.356066:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789181623.356070:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091461032/0x8f4f7840b2e42447 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.356079:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091461032/0x8f4f7840b2e42447 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.356097:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091461032/0x8f4f7840b2e42447 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.356105:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000091461032/0x8f4f7840b2e42447 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.356120:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789181623.356652:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789181623.356658:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d20aa25/0x8f4f7840b2e4244e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.356667:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=515s v=(0 0) 00010000:00010000:2.0:1789181623.356671:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789181623.356675:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004d20aa25/0x8f4f7840b2e4244e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.356695:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004d20aa25/0x8f4f7840b2e4244e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.356704:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d20aa25/0x8f4f7840b2e4244e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.356712:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004d20aa25/0x8f4f7840b2e4244e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.356732:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789181623.356940:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789181623.356947:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000091461032/0x8f4f7840b2e42447 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181623.356956:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1c0259e00 already unused, calling callback (ffffffffc152f9b0) 00010000:00010000:3.0:1789181623.356960:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000091461032/0x8f4f7840b2e42447 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181623.356969:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000091461032/0x8f4f7840b2e42447 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181623.356987:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000091461032/0x8f4f7840b2e42447 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181623.357002:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091461032/0x8f4f7840b2e42447 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181623.357023:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:2.0:1789181623.357389:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789181623.357395:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019f80116/0x8f4f7840b2e42455 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.357404:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=515s v=(0 0) 00010000:00010000:2.0:1789181623.357408:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789181623.357412:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019f80116/0x8f4f7840b2e42455 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.357422:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000019f80116/0x8f4f7840b2e42455 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.357430:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019f80116/0x8f4f7840b2e42455 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.357438:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000019f80116/0x8f4f7840b2e42455 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.357447:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789181623.358002:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789181623.358009:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd91d593/0x8f4f7840b2e4245c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.358018:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=515s v=(0 0) 00010000:00010000:2.0:1789181623.358028:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789181623.358033:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd91d593/0x8f4f7840b2e4245c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.358043:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd91d593/0x8f4f7840b2e4245c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.358052:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd91d593/0x8f4f7840b2e4245c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.358060:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dd91d593/0x8f4f7840b2e4245c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.358069:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789181623.358508:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004d20aa25/0x8f4f7840b2e4244e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181623.358517:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1c0258a00 already unused, calling callback (ffffffffc152f9b0) 00010000:00010000:3.0:1789181623.358521:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004d20aa25/0x8f4f7840b2e4244e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181623.358530:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004d20aa25/0x8f4f7840b2e4244e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181623.358558:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004d20aa25/0x8f4f7840b2e4244e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181623.358566:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004d20aa25/0x8f4f7840b2e4244e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181623.358588:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789181623.358592:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000019f80116/0x8f4f7840b2e42455 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181623.358598:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1c0259a00 already unused, calling callback (ffffffffc152f9b0) 00010000:00010000:3.0:1789181623.358608:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000019f80116/0x8f4f7840b2e42455 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181623.358616:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000019f80116/0x8f4f7840b2e42455 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181623.358630:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000019f80116/0x8f4f7840b2e42455 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181623.358637:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000019f80116/0x8f4f7840b2e42455 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181623.358651:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789181623.358653:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dd91d593/0x8f4f7840b2e4245c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181623.358659:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1c0258000 already unused, calling callback (ffffffffc152f9b0) 00010000:00010000:3.0:1789181623.358662:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd91d593/0x8f4f7840b2e4245c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181623.358669:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd91d593/0x8f4f7840b2e4245c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181623.358679:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dd91d593/0x8f4f7840b2e4245c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789181623.358734:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789181623.358740:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007bba81f6/0x8f4f7840b2e42463 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.358749:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=515s v=(0 0) 00010000:00010000:2.0:1789181623.358752:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789181623.358756:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007bba81f6/0x8f4f7840b2e42463 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181623.358823:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd91d593/0x8f4f7840b2e4245c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.358849:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007bba81f6/0x8f4f7840b2e42463 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181623.358855:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181623.358858:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181623.358862:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181623.358862:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007bba81f6/0x8f4f7840b2e42463 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.358877:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007bba81f6/0x8f4f7840b2e42463 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.358893:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789181623.358902:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789181623.358905:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007bba81f6/0x8f4f7840b2e42463 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.358912:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1c0258e00 already unused, calling callback (ffffffffc152f9b0) 00010000:00010000:2.0:1789181623.358915:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007bba81f6/0x8f4f7840b2e42463 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.358922:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007bba81f6/0x8f4f7840b2e42463 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.358933:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007bba81f6/0x8f4f7840b2e42463 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.358939:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007bba81f6/0x8f4f7840b2e42463 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.358953:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181623.358955:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181623.358957:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789181623.359516:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789181623.359530:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d1bf874/0x8f4f7840b2e4246a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.359540:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=515s v=(0 0) 00010000:00010000:2.0:1789181623.359544:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789181623.359548:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d1bf874/0x8f4f7840b2e4246a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.359559:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d1bf874/0x8f4f7840b2e4246a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.359568:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d1bf874/0x8f4f7840b2e4246a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.359576:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005d1bf874/0x8f4f7840b2e4246a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.359591:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789181623.359601:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789181623.359605:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005d1bf874/0x8f4f7840b2e4246a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.359613:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1c0259c00 already unused, calling callback (ffffffffc152f9b0) 00010000:00010000:2.0:1789181623.359618:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005d1bf874/0x8f4f7840b2e4246a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.359626:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005d1bf874/0x8f4f7840b2e4246a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.359646:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005d1bf874/0x8f4f7840b2e4246a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.359654:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d1bf874/0x8f4f7840b2e4246a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.359672:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181623.359673:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181623.359675:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789181623.362118:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789181623.362131:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6410a0f/0x8f4f7840b2e42471 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.362146:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=515s v=(0 0) 00010000:00010000:2.0:1789181623.362151:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789181623.362157:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c6410a0f/0x8f4f7840b2e42471 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.362172:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c6410a0f/0x8f4f7840b2e42471 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.362182:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6410a0f/0x8f4f7840b2e42471 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.362189:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c6410a0f/0x8f4f7840b2e42471 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.362220:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789181623.362231:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789181623.362237:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c6410a0f/0x8f4f7840b2e42471 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.362246:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1c0258c00 already unused, calling callback (ffffffffc152f9b0) 00010000:00010000:2.0:1789181623.362251:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6410a0f/0x8f4f7840b2e42471 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.362260:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6410a0f/0x8f4f7840b2e42471 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.362365:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c6410a0f/0x8f4f7840b2e42471 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.362375:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c6410a0f/0x8f4f7840b2e42471 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.362394:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181623.362396:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181623.362398:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789181623.362975:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789181623.362981:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4e78cf1/0x8f4f7840b2e42478 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.362991:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=515s v=(0 0) 00010000:00010000:2.0:1789181623.362999:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789181623.363003:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4e78cf1/0x8f4f7840b2e42478 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.363013:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4e78cf1/0x8f4f7840b2e42478 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.363022:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4e78cf1/0x8f4f7840b2e42478 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.363031:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d4e78cf1/0x8f4f7840b2e42478 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.363046:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789181623.363056:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789181623.363061:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d4e78cf1/0x8f4f7840b2e42478 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.363068:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1c0259400 already unused, calling callback (ffffffffc152f9b0) 00010000:00010000:2.0:1789181623.363072:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4e78cf1/0x8f4f7840b2e42478 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.363080:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4e78cf1/0x8f4f7840b2e42478 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.363093:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d4e78cf1/0x8f4f7840b2e42478 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.363113:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4e78cf1/0x8f4f7840b2e42478 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.363128:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181623.363130:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181623.363132:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789181623.363727:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789181623.363734:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000391d8628/0x8f4f7840b2e4247f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.363744:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=515s v=(0 0) 00010000:00010000:2.0:1789181623.363748:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789181623.363753:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000391d8628/0x8f4f7840b2e4247f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.363764:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000391d8628/0x8f4f7840b2e4247f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.363773:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000391d8628/0x8f4f7840b2e4247f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.363781:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000391d8628/0x8f4f7840b2e4247f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.363797:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789181623.363805:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789181623.363814:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000391d8628/0x8f4f7840b2e4247f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.363821:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1ba785000 already unused, calling callback (ffffffffc152f9b0) 00010000:00010000:2.0:1789181623.363825:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000391d8628/0x8f4f7840b2e4247f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.363833:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000391d8628/0x8f4f7840b2e4247f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.363844:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000391d8628/0x8f4f7840b2e4247f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.363852:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000391d8628/0x8f4f7840b2e4247f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.363866:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181623.363868:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181623.363869:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789181623.364367:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789181623.364374:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000018a439f0/0x8f4f7840b2e42486 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.364384:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=515s v=(0 0) 00010000:00010000:2.0:1789181623.364388:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789181623.364393:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018a439f0/0x8f4f7840b2e42486 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.364414:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000018a439f0/0x8f4f7840b2e42486 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.364423:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000018a439f0/0x8f4f7840b2e42486 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.364432:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000018a439f0/0x8f4f7840b2e42486 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.364446:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789181623.364454:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789181623.364461:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000018a439f0/0x8f4f7840b2e42486 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.364469:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1ba784a00 already unused, calling callback (ffffffffc152f9b0) 00010000:00010000:2.0:1789181623.364472:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000018a439f0/0x8f4f7840b2e42486 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.364480:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000018a439f0/0x8f4f7840b2e42486 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.364492:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000018a439f0/0x8f4f7840b2e42486 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.364500:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000018a439f0/0x8f4f7840b2e42486 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.364520:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181623.364521:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181623.364523:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789181623.364946:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789181623.364954:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001734a1b3/0x8f4f7840b2e4248d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.364963:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=515s v=(0 0) 00010000:00010000:2.0:1789181623.364966:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789181623.364971:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001734a1b3/0x8f4f7840b2e4248d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.364982:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001734a1b3/0x8f4f7840b2e4248d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.364991:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001734a1b3/0x8f4f7840b2e4248d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.364999:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001734a1b3/0x8f4f7840b2e4248d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.365015:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789181623.365024:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789181623.365029:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001734a1b3/0x8f4f7840b2e4248d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.365047:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1ba784600 already unused, calling callback (ffffffffc152f9b0) 00010000:00010000:2.0:1789181623.365051:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001734a1b3/0x8f4f7840b2e4248d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.365061:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001734a1b3/0x8f4f7840b2e4248d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.365074:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001734a1b3/0x8f4f7840b2e4248d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.365082:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001734a1b3/0x8f4f7840b2e4248d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.365101:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181623.365104:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181623.365107:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789181623.365675:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789181623.365714:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006eeb83d6/0x8f4f7840b2e42494 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.365724:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=515s v=(0 0) 00010000:00010000:2.0:1789181623.365728:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789181623.365733:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006eeb83d6/0x8f4f7840b2e42494 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.365745:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006eeb83d6/0x8f4f7840b2e42494 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.365761:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006eeb83d6/0x8f4f7840b2e42494 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.365769:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006eeb83d6/0x8f4f7840b2e42494 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.365783:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789181623.365792:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789181623.365796:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006eeb83d6/0x8f4f7840b2e42494 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.365803:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1ba784400 already unused, calling callback (ffffffffc152f9b0) 00010000:00010000:2.0:1789181623.365807:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006eeb83d6/0x8f4f7840b2e42494 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.365815:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006eeb83d6/0x8f4f7840b2e42494 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.365827:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006eeb83d6/0x8f4f7840b2e42494 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.365835:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006eeb83d6/0x8f4f7840b2e42494 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.365847:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181623.365854:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181623.365855:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789181623.366399:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789181623.366404:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027b46327/0x8f4f7840b2e4249b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.366411:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=515s v=(0 0) 00010000:00010000:2.0:1789181623.366414:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789181623.366417:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027b46327/0x8f4f7840b2e4249b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.366424:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000027b46327/0x8f4f7840b2e4249b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.366429:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027b46327/0x8f4f7840b2e4249b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.366434:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000027b46327/0x8f4f7840b2e4249b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.366442:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789181623.366448:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789181623.366450:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000027b46327/0x8f4f7840b2e4249b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.366454:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1ba784e00 already unused, calling callback (ffffffffc152f9b0) 00010000:00010000:2.0:1789181623.366456:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000027b46327/0x8f4f7840b2e4249b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.366469:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000027b46327/0x8f4f7840b2e4249b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.366478:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000027b46327/0x8f4f7840b2e4249b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.366482:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000027b46327/0x8f4f7840b2e4249b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.366491:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181623.366492:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181623.366492:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789181623.366807:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789181623.366816:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000603b7761/0x8f4f7840b2e424a2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.366823:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=515s v=(0 0) 00010000:00010000:2.0:1789181623.366825:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789181623.366827:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000603b7761/0x8f4f7840b2e424a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.366833:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000603b7761/0x8f4f7840b2e424a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.366838:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000603b7761/0x8f4f7840b2e424a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.366847:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000603b7761/0x8f4f7840b2e424a2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.366855:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789181623.366861:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789181623.366863:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000603b7761/0x8f4f7840b2e424a2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.366867:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1ba784800 already unused, calling callback (ffffffffc152f9b0) 00010000:00010000:2.0:1789181623.366869:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000603b7761/0x8f4f7840b2e424a2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.366874:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000603b7761/0x8f4f7840b2e424a2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.366880:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000603b7761/0x8f4f7840b2e424a2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.366884:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000603b7761/0x8f4f7840b2e424a2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.366891:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181623.366892:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181623.366893:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789181623.367190:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789181623.367201:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0230f91/0x8f4f7840b2e424a9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.367209:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=515s v=(0 0) 00010000:00010000:2.0:1789181623.367212:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789181623.367216:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0230f91/0x8f4f7840b2e424a9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.367225:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0230f91/0x8f4f7840b2e424a9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.367233:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0230f91/0x8f4f7840b2e424a9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.367240:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a0230f91/0x8f4f7840b2e424a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.367262:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789181623.367646:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789181623.367652:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0aef82c/0x8f4f7840b2e424b0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.367661:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=515s v=(0 0) 00010000:00010000:2.0:1789181623.367665:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789181623.367669:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0aef82c/0x8f4f7840b2e424b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.367678:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0aef82c/0x8f4f7840b2e424b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.367705:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0aef82c/0x8f4f7840b2e424b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.367713:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b0aef82c/0x8f4f7840b2e424b0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.367721:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1789181623.368088:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789181623.368094:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014a81357/0x8f4f7840b2e424b7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181623.368096:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789181623.368106:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a0230f91/0x8f4f7840b2e424a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.368107:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=515s v=(0 0) 00010000:00010000:2.0:1789181623.368114:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789181623.368123:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014a81357/0x8f4f7840b2e424b7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181623.368124:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1ba785600 already unused, calling callback (ffffffffc152f9b0) 00010000:00010000:0.0:1789181623.368130:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0230f91/0x8f4f7840b2e424a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.368138:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014a81357/0x8f4f7840b2e424b7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181623.368144:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0230f91/0x8f4f7840b2e424a9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.368150:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014a81357/0x8f4f7840b2e424b7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.368161:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014a81357/0x8f4f7840b2e424b7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181623.368167:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a0230f91/0x8f4f7840b2e424a9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181623.368179:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0230f91/0x8f4f7840b2e424a9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.368186:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789181623.368202:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789181623.368207:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b0aef82c/0x8f4f7840b2e424b0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181623.368215:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1ba785400 already unused, calling callback (ffffffffc152f9b0) 00010000:00010000:0.0:1789181623.368218:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0aef82c/0x8f4f7840b2e424b0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181623.368238:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0aef82c/0x8f4f7840b2e424b0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181623.368249:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b0aef82c/0x8f4f7840b2e424b0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181623.368257:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0aef82c/0x8f4f7840b2e424b0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181623.368272:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789181623.368275:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014a81357/0x8f4f7840b2e424b7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181623.368282:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1ba784c00 already unused, calling callback (ffffffffc152f9b0) 00010000:00010000:0.0:1789181623.368285:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014a81357/0x8f4f7840b2e424b7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181623.368293:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014a81357/0x8f4f7840b2e424b7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181623.368304:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014a81357/0x8f4f7840b2e424b7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181623.368311:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014a81357/0x8f4f7840b2e424b7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181623.368361:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181623.368370:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181623.368372:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789181623.368609:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789181623.368615:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c94b53df/0x8f4f7840b2e424be lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.368623:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=515s v=(0 0) 00010000:00010000:2.0:1789181623.368625:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789181623.368630:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c94b53df/0x8f4f7840b2e424be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.368639:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c94b53df/0x8f4f7840b2e424be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.368647:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c94b53df/0x8f4f7840b2e424be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.368654:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c94b53df/0x8f4f7840b2e424be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.368677:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789181623.369088:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789181623.369094:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf918e38/0x8f4f7840b2e424c5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.369102:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=515s v=(0 0) 00010000:00010000:2.0:1789181623.369111:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789181623.369116:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf918e38/0x8f4f7840b2e424c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.369126:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cf918e38/0x8f4f7840b2e424c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.369135:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf918e38/0x8f4f7840b2e424c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.369142:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cf918e38/0x8f4f7840b2e424c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.369156:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1789181623.369571:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789181623.369577:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000145de9a4/0x8f4f7840b2e424cc lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.369585:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=515s v=(0 0) 00010000:00010000:2.0:1789181623.369589:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789181623.369593:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000145de9a4/0x8f4f7840b2e424cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.369604:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000145de9a4/0x8f4f7840b2e424cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.369612:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000145de9a4/0x8f4f7840b2e424cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.369625:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000145de9a4/0x8f4f7840b2e424cc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.369634:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1789181623.370180:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789181623.370188:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a739ef0/0x8f4f7840b2e424d3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181623.370197:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=515s v=(0 0) 00010000:00010000:3.0:1789181623.370201:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789181623.370206:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004a739ef0/0x8f4f7840b2e424d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181623.370216:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004a739ef0/0x8f4f7840b2e424d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181623.370224:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a739ef0/0x8f4f7840b2e424d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181623.370232:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004a739ef0/0x8f4f7840b2e424d3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181623.370240:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1789181623.370934:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789181623.370941:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000729fff60/0x8f4f7840b2e424da lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181623.370962:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=515s v=(0 0) 00010000:00010000:3.0:1789181623.370965:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789181623.370970:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000729fff60/0x8f4f7840b2e424da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181623.370980:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000729fff60/0x8f4f7840b2e424da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181623.370988:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000729fff60/0x8f4f7840b2e424da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181623.370995:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000729fff60/0x8f4f7840b2e424da lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181623.371003:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:0.0:1789181623.371203:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1789181623.371212:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c94b53df/0x8f4f7840b2e424be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181623.371220:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1ba785800 already unused, calling callback (ffffffffc152f9b0) 00010000:00010000:0.0:1789181623.371225:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c94b53df/0x8f4f7840b2e424be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181623.371234:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c94b53df/0x8f4f7840b2e424be lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181623.371250:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c94b53df/0x8f4f7840b2e424be lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181623.371257:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c94b53df/0x8f4f7840b2e424be lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181623.371275:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1789181623.371279:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cf918e38/0x8f4f7840b2e424c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181623.371285:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1ba784000 already unused, calling callback (ffffffffc152f9b0) 00010000:00010000:0.0:1789181623.371294:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf918e38/0x8f4f7840b2e424c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181623.371328:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf918e38/0x8f4f7840b2e424c5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181623.371390:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cf918e38/0x8f4f7840b2e424c5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181623.371397:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cf918e38/0x8f4f7840b2e424c5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:0.0:1789181623.372281:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1789181623.372298:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789181623.372303:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000145de9a4/0x8f4f7840b2e424cc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181623.372312:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1ba785200 already unused, calling callback (ffffffffc152f9b0) 00010000:00010000:0.0:1789181623.372316:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000145de9a4/0x8f4f7840b2e424cc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181623.372325:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000145de9a4/0x8f4f7840b2e424cc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181623.372373:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000145de9a4/0x8f4f7840b2e424cc lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181623.372392:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000145de9a4/0x8f4f7840b2e424cc lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181623.372409:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789181623.372413:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004a739ef0/0x8f4f7840b2e424d3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181623.372420:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1bfa1fe00 already unused, calling callback (ffffffffc152f9b0) 00010000:00010000:0.0:1789181623.372423:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004a739ef0/0x8f4f7840b2e424d3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181623.372430:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004a739ef0/0x8f4f7840b2e424d3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181623.372441:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004a739ef0/0x8f4f7840b2e424d3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181623.372448:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004a739ef0/0x8f4f7840b2e424d3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181623.372898:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789181623.372904:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000729fff60/0x8f4f7840b2e424da lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181623.372911:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1bfa1f200 already unused, calling callback (ffffffffc152f9b0) 00010000:00010000:0.0:1789181623.372921:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000729fff60/0x8f4f7840b2e424da lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181623.372930:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000729fff60/0x8f4f7840b2e424da lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181623.372943:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000729fff60/0x8f4f7840b2e424da lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181623.372950:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000729fff60/0x8f4f7840b2e424da lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181623.376089:0:16126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181623.376097:0:16126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181623.376100:0:16126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181623.376113:0:14412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000703a74d9/0x8f4f7840b2e42432 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181623.376128:0:14412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1c0259200 already unused, calling callback (ffffffffc152f9b0) 00010000:00010000:3.0:1789181623.376133:0:14412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000703a74d9/0x8f4f7840b2e42432 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181623.376143:0:14412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000703a74d9/0x8f4f7840b2e42432 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181623.376175:0:14412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000703a74d9/0x8f4f7840b2e42432 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181623.376184:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000703a74d9/0x8f4f7840b2e42432 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181623.376204:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181623.376206:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181623.376208:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789181623.376394:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789181623.376402:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d47cdaa/0x8f4f7840b2e424e1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181623.376414:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=515s v=(0 0) 00010000:00010000:3.0:1789181623.376418:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789181623.376424:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d47cdaa/0x8f4f7840b2e424e1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181623.376436:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d47cdaa/0x8f4f7840b2e424e1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181623.376446:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d47cdaa/0x8f4f7840b2e424e1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181623.376454:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005d47cdaa/0x8f4f7840b2e424e1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181623.376485:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789181623.376727:0:16126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789181623.376734:0:16126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005d47cdaa/0x8f4f7840b2e424e1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.376744:0:16126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1bfa1f400 already unused, calling callback (ffffffffc152f9b0) 00010000:00010000:2.0:1789181623.376748:0:16126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005d47cdaa/0x8f4f7840b2e424e1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.376756:0:16126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005d47cdaa/0x8f4f7840b2e424e1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.376769:0:16126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005d47cdaa/0x8f4f7840b2e424e1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.376777:0:16126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d47cdaa/0x8f4f7840b2e424e1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181623.376795:0:16126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181623.376797:0:16126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789181623.376799:0:16126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1789181623.377050:0:15109:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:3.0:1789181623.377917:0:15109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c36d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:14448:x1876092510114176:12345-0@lo:5:osp-pre-1-0.0 Request processed in 64997us (68865us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181623.377933:0:15109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1789181623.382828:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181623.383154:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789181623.383158:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181623.386704:0:14448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc19c36c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14448:1876092510114176:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1789181623.386748:0:14448:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:2.0:1789181623.387041:0:14448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc19c36c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14448:1876092510114304:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1789181623.387103:0:14448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181623.387143:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510114304 00000100:00100000:2.0:1789181623.387149:0:15106:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510114304 00000100:00100000:2.0:1789181623.387192:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789181623.387202:0:15106:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c36d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:14448:x1876092510114304:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1789181623.387241:0:15106:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:2.0:1789181623.403941:0:15106:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c36d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14448:x1876092510114304:12345-0@lo:5:osp-pre-1-0.0 Request processed in 16732us (16829us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1789181623.403954:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789181623.404402:0:14448:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1879a6600 going to sleep for 11 seconds 00000100:00100000:3.0:1789181623.404439:0:14448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc19c36c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14448:1876092510114304:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1789181623.404454:0:14448:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000004:00080000:3.0:1789181623.424097:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:3.0:1789181623.498587:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789181624.308405:0:16184:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg432-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789181624.510643:0:16126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789181624.836121:0:14458:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789181625.537389:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181626.558455:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181626.898813:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181626.899111:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488097280 00000100:00100000:1.0:1789181626.899121:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488097280 00000100:00100000:1.0:1789181626.899263:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 76 00000100:00100000:1.0:1789181626.899272:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bbadbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2350:x1876092488097280:12345-192.168.204.32@tcp:250:mount.lustre.0 00010000:00080000:1.0:1789181626.899300:0:14417:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from e09b034e-9c19-4cf8-a37d-2da41b05039c@192.168.204.32@tcp t0 exp 0000000000000000 cur 519 last 0 00000020:00000080:1.0:1789181626.899325:0:14417:0:(genops.c:1384:class_connect()) connect: client e09b034e-9c19-4cf8-a37d-2da41b05039c, cookie 0x8f4f7840b2e424e8 00000100:00080000:1.0:1789181626.899545:0:14417:0:(import.c:65:import_set_state_nolock()) ffff9dc0822b1000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789181626.899716:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bbadbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e09b034e-9c19-4cf8-a37d-2da41b05039c+5:2350:x1876092488097280:12345-192.168.204.32@tcp:250:mount.lustre.0 Request processed in 442us (910us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181626.899723:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 76 00000100:00100000:0.0:1789181626.910025:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181626.910150:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488097408 00000100:00100000:2.0:1789181626.910160:0:14418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488097408 00000100:00100000:2.0:1789181626.910220:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 77 00000100:00100000:2.0:1789181626.910230:0:14418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bbadb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e09b034e-9c19-4cf8-a37d-2da41b05039c+5:13741:x1876092488097408:12345-192.168.204.32@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789181626.910246:0:14418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181626.910262:0:14418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc1ba785c00/0x8f4f7840b2e424ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f3e4 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181626.910289:0:14418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc1ba785c00/0x8f4f7840b2e424ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f3e4 expref: 6 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181626.910300:0:14418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc1ba785c00/0x8f4f7840b2e424ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f3e4 expref: 6 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181626.910308:0:14418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1ba785c00, rc 0) 00000100:00100000:2.0:1789181626.910461:0:14418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bbadb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e09b034e-9c19-4cf8-a37d-2da41b05039c+6:13741:x1876092488097408:12345-192.168.204.32@tcp:101:mount.lustre.0 Request processed in 232us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181626.910470:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 77 00000100:00100000:3.0:1789181626.911737:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181626.911860:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488097536 00000100:00100000:1.0:1789181626.911866:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488097536 00000100:00100000:1.0:1789181626.911899:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 78 00000100:00100000:1.0:1789181626.911906:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bbada450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e09b034e-9c19-4cf8-a37d-2da41b05039c+6:13741:x1876092488097536:12345-192.168.204.32@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789181626.912249:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bbada450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e09b034e-9c19-4cf8-a37d-2da41b05039c+6:13741:x1876092488097536:12345-192.168.204.32@tcp:501:mount.lustre.0 Request processed in 343us (516us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789181626.912257:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 78 00000100:00100000:0.0:1789181626.917221:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181626.917374:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488097664 00000100:00100000:2.0:1789181626.917385:0:14418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488097664 00000100:00100000:2.0:1789181626.917443:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 79 00000100:00100000:2.0:1789181626.917453:0:14418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bbad9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e09b034e-9c19-4cf8-a37d-2da41b05039c+6:13741:x1876092488097664:12345-192.168.204.32@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789181626.917469:0:14418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181626.917486:0:14418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc1ba785e00/0x8f4f7840b2e424f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f3eb expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181626.917513:0:14418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc1ba785e00/0x8f4f7840b2e424f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f3eb expref: 7 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181626.917524:0:14418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc1ba785e00/0x8f4f7840b2e424f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f3eb expref: 7 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181626.917533:0:14418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1ba785e00, rc 0) 00000100:00100000:2.0:1789181626.917580:0:14418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bbad9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e09b034e-9c19-4cf8-a37d-2da41b05039c+7:13741:x1876092488097664:12345-192.168.204.32@tcp:101:mount.lustre.0 Request processed in 129us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181626.917587:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 79 00000100:00100000:0.0:1789181626.919218:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181626.919297:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488097792 00000100:00100000:1.0:1789181626.919316:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488097792 00000100:00100000:1.0:1789181626.919384:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 80 00000100:00100000:1.0:1789181626.919394:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bbad9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e09b034e-9c19-4cf8-a37d-2da41b05039c+7:13741:x1876092488097792:12345-192.168.204.32@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789181626.919682:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bbad9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e09b034e-9c19-4cf8-a37d-2da41b05039c+8:13741:x1876092488097792:12345-192.168.204.32@tcp:501:mount.lustre.0 Request processed in 289us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181626.919689:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 80 00000100:00100000:3.0:1789181626.923149:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181626.923224:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488097920 00000100:00100000:2.0:1789181626.923236:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488097920 00000100:00100000:2.0:1789181626.923292:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 81 00000100:00100000:2.0:1789181626.923302:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bbad9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e09b034e-9c19-4cf8-a37d-2da41b05039c+8:13741:x1876092488097920:12345-192.168.204.32@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789181626.923667:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bbad9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e09b034e-9c19-4cf8-a37d-2da41b05039c+8:13741:x1876092488097920:12345-192.168.204.32@tcp:503:mount.lustre.0 Request processed in 365us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181626.923686:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 81 00000100:00100000:2.0:1789181626.928646:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181626.928733:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488098048 00000100:00100000:1.0:1789181626.928742:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488098048 00000100:00100000:1.0:1789181626.928829:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 82 00000100:00100000:1.0:1789181626.928841:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bbad8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e09b034e-9c19-4cf8-a37d-2da41b05039c+8:13760:x1876092488098048:12345-192.168.204.32@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789181626.929200:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bbad8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e09b034e-9c19-4cf8-a37d-2da41b05039c+8:13760:x1876092488098048:12345-192.168.204.32@tcp:502:llog_process_th.0 Request processed in 362us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181626.929208:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 82 00000100:00100000:0.0:1789181626.938876:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181626.941863:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488098176 00000100:00100000:2.0:1789181626.941879:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488098176 00000100:00100000:2.0:1789181626.942004:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 83 00000100:00100000:2.0:1789181626.942016:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bbadac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e09b034e-9c19-4cf8-a37d-2da41b05039c+8:13760:x1876092488098176:12345-192.168.204.32@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789181626.942300:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bbadac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e09b034e-9c19-4cf8-a37d-2da41b05039c+8:13760:x1876092488098176:12345-192.168.204.32@tcp:502:llog_process_th.0 Request processed in 285us (3435us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181626.942308:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 83 00000100:00100000:2.0:1789181626.953966:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181626.954027:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488098304 00000100:00100000:1.0:1789181626.954038:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488098304 00000100:00100000:1.0:1789181626.955537:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 84 00000100:00100000:1.0:1789181626.955556:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bbad8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e09b034e-9c19-4cf8-a37d-2da41b05039c+8:13741:x1876092488098304:12345-192.168.204.32@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789181626.955576:0:14417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181626.955595:0:14417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc1baab9000/0x8f4f7840b2e424fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f415 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181626.955641:0:14417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc1baab9000/0x8f4f7840b2e424fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f415 expref: 9 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181626.955653:0:14417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc1baab9000/0x8f4f7840b2e424fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f415 expref: 9 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181626.955681:0:14417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1baab9000, rc 0) 00000100:00100000:1.0:1789181626.955740:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bbad8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e09b034e-9c19-4cf8-a37d-2da41b05039c+9:13741:x1876092488098304:12345-192.168.204.32@tcp:101:mount.lustre.0 Request processed in 191us (1783us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181626.955747:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 84 00000100:00100000:0.0:1789181626.959904:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181626.960001:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488098432 00000100:00100000:2.0:1789181626.960013:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488098432 00000100:00100000:2.0:1789181626.960070:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 85 00000100:00100000:2.0:1789181626.960082:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bbad9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e09b034e-9c19-4cf8-a37d-2da41b05039c+9:13741:x1876092488098432:12345-192.168.204.32@tcp:256:mount.lustre.0 20000000:01000000:2.0:1789181626.960123:0:14416:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789181626.960148:0:14416:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789181626.960152:0:14416:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789181626.960155:0:14416:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789181626.960157:0:14416:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1789181626.962994:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bbad9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e09b034e-9c19-4cf8-a37d-2da41b05039c+9:13741:x1876092488098432:12345-192.168.204.32@tcp:256:mount.lustre.0 Request processed in 2905us (3091us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181626.963008:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 85 00000100:00100000:3.0:1789181626.965874:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181626.968105:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488098560 00000100:00100000:2.0:1789181626.968120:0:14418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488098560 00000100:00100000:2.0:1789181626.968197:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 86 00000100:00100000:2.0:1789181626.968210:0:14418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bbad8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e09b034e-9c19-4cf8-a37d-2da41b05039c+9:13741:x1876092488098560:12345-192.168.204.32@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789181626.968241:0:14418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181626.968258:0:14418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc1ba784a00/0x8f4f7840b2e42504 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f41c expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181626.968288:0:14418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc1ba784a00/0x8f4f7840b2e42504 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f41c expref: 10 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181626.968299:0:14418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc1ba784a00/0x8f4f7840b2e42504 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f41c expref: 10 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181626.968308:0:14418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1ba784a00, rc 0) 00000100:00100000:2.0:1789181626.968397:0:14418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bbad8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e09b034e-9c19-4cf8-a37d-2da41b05039c+10:13741:x1876092488098560:12345-192.168.204.32@tcp:101:mount.lustre.0 Request processed in 190us (2533us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181626.968405:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 86 00000100:00100000:0.0:1789181626.976066:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181626.979074:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488098688 00000100:00100000:2.0:1789181626.979088:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488098688 00000100:00100000:2.0:1789181626.979166:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 87 00000100:00100000:2.0:1789181626.979177:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bbada850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e09b034e-9c19-4cf8-a37d-2da41b05039c+10:13741:x1876092488098688:12345-192.168.204.32@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789181626.979486:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bbada850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e09b034e-9c19-4cf8-a37d-2da41b05039c+10:13741:x1876092488098688:12345-192.168.204.32@tcp:501:mount.lustre.0 Request processed in 310us (3430us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181626.979494:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 87 00000100:00100000:0.0:1789181626.982905:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181626.982996:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488098816 00000100:00100000:1.0:1789181626.983005:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488098816 00000100:00100000:1.0:1789181626.983056:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 88 00000100:00100000:1.0:1789181626.983065:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bbada050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e09b034e-9c19-4cf8-a37d-2da41b05039c+10:13741:x1876092488098816:12345-192.168.204.32@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789181626.983387:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bbada050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e09b034e-9c19-4cf8-a37d-2da41b05039c+10:13741:x1876092488098816:12345-192.168.204.32@tcp:503:mount.lustre.0 Request processed in 323us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181626.983396:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 88 00000100:00100000:0.0:1789181626.991064:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181626.991317:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488098944 00000100:00100000:3.0:1789181626.991328:0:14418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488098944 00000100:00100000:3.0:1789181626.991421:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 89 00000100:00100000:3.0:1789181626.991432:0:14418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bbad8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e09b034e-9c19-4cf8-a37d-2da41b05039c+10:13764:x1876092488098944:12345-192.168.204.32@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789181626.991742:0:14418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bbad8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e09b034e-9c19-4cf8-a37d-2da41b05039c+10:13764:x1876092488098944:12345-192.168.204.32@tcp:502:llog_process_th.0 Request processed in 310us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181626.991750:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 89 00000100:00100000:0.0:1789181626.993853:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181626.994119:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488099072 00000100:00100000:2.0:1789181626.994129:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488099072 00000100:00100000:2.0:1789181626.994189:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 90 00000100:00100000:2.0:1789181626.994200:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bbadb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e09b034e-9c19-4cf8-a37d-2da41b05039c+10:13764:x1876092488099072:12345-192.168.204.32@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789181626.994462:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bbadb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e09b034e-9c19-4cf8-a37d-2da41b05039c+10:13764:x1876092488099072:12345-192.168.204.32@tcp:502:llog_process_th.0 Request processed in 263us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181626.994475:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 90 00000100:00100000:0.0:1789181627.010169:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181627.011304:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488099200 00000100:00100000:2.0:1789181627.011317:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488099200 00000100:00100000:2.0:1789181627.011418:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 4 00000100:00100000:2.0:1789181627.011427:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c01c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2350:x1876092488099200:12345-192.168.204.32@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789181627.011456:0:14425:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 049cbf1a-15b2-4d25-854c-0a3797b8f42e@192.168.204.32@tcp t0 exp 0000000000000000 cur 519 last 0 00000020:00000080:2.0:1789181627.011508:0:14425:0:(genops.c:1384:class_connect()) connect: client 049cbf1a-15b2-4d25-854c-0a3797b8f42e, cookie 0x8f4f7840b2e4250b 00000004:00100000:2.0:1789181627.011536:0:14425:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1789181627.011542:0:14425:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:2.0:1789181627.051137:0:14425:0:(import.c:65:import_set_state_nolock()) ffff9dc1b6718000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789181627.051405:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c01c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:049cbf1a-15b2-4d25-854c-0a3797b8f42e+6:2350:x1876092488099200:12345-192.168.204.32@tcp:38:mount.lustre.0 Request processed in 39968us (41236us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181627.051418:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 4 00000100:00100000:0.0:1789181627.058242:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181627.058641:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488099328 00000100:00100000:2.0:1789181627.058663:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488099328 00000100:00100000:0.0:1789181627.058991:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181627.059064:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488099456 00000100:00100000:1.0:1789181627.059069:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488099456 00000100:00100000:2.0:1789181627.059130:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 5 00000100:00100000:2.0:1789181627.059151:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c01c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:049cbf1a-15b2-4d25-854c-0a3797b8f42e+7:0:x1876092488099328:12345-192.168.204.32@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789181627.059207:0:14424:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00080000:3.0:1789181627.059560:0:14419:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789181627.059866:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 6 00000100:00100000:3.0:1789181627.059877:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c01c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:049cbf1a-15b2-4d25-854c-0a3797b8f42e+7:13741:x1876092488099456:12345-192.168.204.32@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789181627.059897:0:14425:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789181627.059948:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c01c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:049cbf1a-15b2-4d25-854c-0a3797b8f42e+7:13741:x1876092488099456:12345-192.168.204.32@tcp:41:mount.lustre.0 Request processed in 74us (957us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181627.059956:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 6 00000100:00100000:0.0:1789181627.060878:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c01c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:049cbf1a-15b2-4d25-854c-0a3797b8f42e+6:0:x1876092488099328:12345-192.168.204.32@tcp:41:mount.lustre.0 Request processed in 1734us (2641us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181627.060886:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 5 00000100:00100000:0.0:1789181627.064437:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181627.064530:0:15740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488099584 00000100:00100000:3.0:1789181627.064548:0:15740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488099584 00000100:00100000:3.0:1789181627.064609:0:15740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 7 00000100:00100000:3.0:1789181627.064629:0:15740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c01c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:049cbf1a-15b2-4d25-854c-0a3797b8f42e+6:13741:x1876092488099584:12345-192.168.204.32@tcp:40:mount.lustre.0 00000100:00100000:3.0:1789181627.064841:0:15740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c01c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:049cbf1a-15b2-4d25-854c-0a3797b8f42e+6:13741:x1876092488099584:12345-192.168.204.32@tcp:40:mount.lustre.0 Request processed in 213us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181627.064848:0:15740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 7 00000100:00100000:1.0:1789181627.078295:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181627.078442:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181627.078481:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181627.078639:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488099712 00000100:00100000:0.0:1789181627.078658:0:15107:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488099712 00000100:00100000:0.0:1789181627.078697:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488099840 00000100:00100000:0.0:1789181627.078700:0:15107:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488099840 00000100:00100000:0.0:1789181627.078715:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 7 00000100:00100000:0.0:1789181627.078724:0:15107:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6e5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2350:x1876092488099712:12345-192.168.204.32@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789181627.078754:0:15107:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 049cbf1a-15b2-4d25-854c-0a3797b8f42e@192.168.204.32@tcp t0 exp 0000000000000000 cur 519 last 0 00000020:00000080:0.0:1789181627.078785:0:15107:0:(genops.c:1384:class_connect()) connect: client 049cbf1a-15b2-4d25-854c-0a3797b8f42e, cookie 0x8f4f7840b2e42512 00002000:00100000:0.0:1789181627.078797:0:15107:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 049cbf1a-15b2-4d25-854c-0a3797b8f42e/ffff9dc185292000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789181627.078822:0:15107:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789181627.079147:0:15107:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789181627.079254:0:15107:0:(import.c:65:import_set_state_nolock()) ffff9dc185296000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789181627.079398:0:15107:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6e5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:049cbf1a-15b2-4d25-854c-0a3797b8f42e+6:2350:x1876092488099712:12345-192.168.204.32@tcp:8:mount.lustre.0 Request processed in 673us (954us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181627.079406:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 7 00000100:00100000:0.0:1789181627.079424:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 8 00000100:00100000:0.0:1789181627.079429:0:15107:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6e5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2350:x1876092488099840:12345-192.168.204.32@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789181627.079444:0:15107:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 049cbf1a-15b2-4d25-854c-0a3797b8f42e@192.168.204.32@tcp t0 exp 0000000000000000 cur 519 last 0 00000020:00000080:0.0:1789181627.079461:0:15107:0:(genops.c:1384:class_connect()) connect: client 049cbf1a-15b2-4d25-854c-0a3797b8f42e, cookie 0x8f4f7840b2e42519 00002000:00100000:0.0:1789181627.079483:0:15107:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 049cbf1a-15b2-4d25-854c-0a3797b8f42e/ffff9dc185290800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789181627.079498:0:15107:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789181627.079639:0:15107:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789181627.079655:0:15107:0:(import.c:65:import_set_state_nolock()) ffff9dc185291000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789181627.079679:0:15107:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6e5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:049cbf1a-15b2-4d25-854c-0a3797b8f42e+6:2350:x1876092488099840:12345-192.168.204.32@tcp:8:mount.lustre.0 Request processed in 248us (1198us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181627.079686:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 8 00000100:00100000:2.0:1789181627.089787:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488099968 00000100:00100000:2.0:1789181627.089806:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488099968 00000100:00100000:2.0:1789181627.089881:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 0 00000100:00100000:2.0:1789181627.089892:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6e5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:049cbf1a-15b2-4d25-854c-0a3797b8f42e+6:13741:x1876092488099968:12345-192.168.204.32@tcp:33:mount.lustre.0 00000004:00080000:1.0:1789181627.094536:0:14426:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 4566us 00000004:00200000:2.0:1789181627.113093:0:14426:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1789181627.113208:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6e5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:049cbf1a-15b2-4d25-854c-0a3797b8f42e+6:13741:x1876092488099968:12345-192.168.204.32@tcp:33:mount.lustre.0 Request processed in 23312us (34916us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181627.113229:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 0 00000100:00100000:1.0:1789181627.324910:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181627.325027:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488100096 00000100:00100000:2.0:1789181627.325037:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488100096 00000100:00100000:2.0:1789181627.325098:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 8 00000100:00100000:2.0:1789181627.325124:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6e5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:049cbf1a-15b2-4d25-854c-0a3797b8f42e+6:13785:x1876092488100096:12345-192.168.204.32@tcp:101:mkdir.0 00010000:00010000:2.0:1789181627.325146:0:14423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181627.325643:0:14423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784400/0x8f4f7840b2e42520 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f446 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181627.325712:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784e00/0x8f4f7840b2e42527 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181627.325726:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784e00/0x8f4f7840b2e42527 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181627.325741:0:14423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784e00/0x8f4f7840b2e42527 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789181627.325776:0:14423:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789181627.325779:0:14423:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789181627.325815:0:14423:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784e00/0x8f4f7840b2e42527 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181627.325843:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784400/0x8f4f7840b2e42520 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f446 expref: 8 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181627.325862:0:14423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784e00/0x8f4f7840b2e42527 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f446 expref: 7 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181627.325888:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc18a6c2500) 00010000:00010000:2.0:1789181627.325891:0:14423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789181627.325895:0:14423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1ba784e00, rc 0) 00000100:00100000:2.0:1789181627.325955:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6e5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:049cbf1a-15b2-4d25-854c-0a3797b8f42e+7:13785:x1876092488100096:12345-192.168.204.32@tcp:101:mkdir.0 Request processed in 847us (1060us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181627.325962:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 8 00000100:00100000:3.0:1789181627.391134:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789181627.391160:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc19c36e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876092510114432:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789181627.391236:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181627.391442:0:15111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510114432 00000100:00100000:2.0:1789181627.391452:0:15111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510114432 00000100:00100000:2.0:1789181627.391528:0:15111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789181627.391539:0:15111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1988c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876092510114432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789181627.391567:0:15111:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789181627.391626:0:15111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1988c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876092510114432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181627.391633:0:15111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1789181627.392301:0:14419:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789181627.392368:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc19c36e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876092510114432:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789181627.582563:0:16126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181628.414627:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc19c36d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:486954f1-c2e6-402a-b3c8-096af476560c:3305:1876092510114560:0@lo:400:kworker.0 00000100:00100000:1.0:1789181628.414696:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181628.414755:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789181628.414761:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1988c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510114688:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789181628.414801:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181628.414830:0:15111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510114688 00000100:00100000:1.0:1789181628.414851:0:15111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510114688 00000100:00100000:1.0:1789181628.414899:0:15111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789181628.414906:0:15111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6e5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1876092510114688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789181628.414926:0:15111:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789181628.414966:0:15111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6e5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1876092510114688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181628.414973:0:15111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789181628.415016:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1988c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510114688:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789181628.415042:0:14419:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789181628.415052:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510114560 00000100:00100000:1.0:1789181628.415055:0:14418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510114560 00000100:00100000:1.0:1789181628.415076:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789181628.415081:0:14418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bbadc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:486954f1-c2e6-402a-b3c8-096af476560c+19:3305:x1876092510114560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181628.415110:0:14418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bbadc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:486954f1-c2e6-402a-b3c8-096af476560c+19:3305:x1876092510114560:12345-0@lo:400:kworker.0 Request processed in 29us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181628.415117:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789181628.415144:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc19c36d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:486954f1-c2e6-402a-b3c8-096af476560c:3305:1876092510114560:0@lo:400:kworker.0 00000100:00100000:2.0:1789181628.421648:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789181628.421671:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc19c36f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876092510114816:0@lo:400:kworker.0 00000100:00100000:2.0:1789181628.421901:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181628.421949:0:15109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510114816 00000100:00100000:2.0:1789181628.421956:0:15109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510114816 00000100:00100000:2.0:1789181628.421999:0:15109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789181628.422007:0:15109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c36ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876092510114816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181628.422055:0:15109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c36ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876092510114816:12345-0@lo:400:kworker.0 Request processed in 48us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181628.422062:0:15109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789181628.422114:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc19c36f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876092510114816:0@lo:400:kworker.0 00000100:00100000:3.0:1789181628.422208:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc19c36fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1876092510115072:0@lo:400:kworker.0 00000100:00100000:3.0:1789181628.422244:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181628.422922:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510115072 00000100:00100000:2.0:1789181628.422928:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510115072 00000100:00100000:2.0:1789181628.422968:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789181628.422976:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1988c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876092510115072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181628.425476:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1988c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876092510115072:12345-0@lo:400:kworker.0 Request processed in 2490us (3220us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181628.425491:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1789181628.425535:0:14419:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789181628.425554:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc19c36f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876092510114944:0@lo:400:kworker.0 00000100:00100000:3.0:1789181628.428113:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc19c36fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1876092510115072:0@lo:400:kworker.0 00000100:00100000:2.0:1789181628.428544:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181628.443690:0:15740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510114944 00000100:00100000:3.0:1789181628.443706:0:15740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510114944 00000100:00100000:3.0:1789181628.443985:0:15740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789181628.443997:0:15740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c36f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876092510114944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181628.444099:0:15740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c36f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876092510114944:12345-0@lo:400:kworker.0 Request processed in 105us (15555us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181628.444123:0:15740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789181628.444473:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc19c36f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876092510114944:0@lo:400:kworker.0 00000100:00100000:3.0:1789181628.446493:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789181628.446513:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc19c36c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1876092510115200:0@lo:400:kworker.0 00000100:00100000:3.0:1789181628.446573:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181628.453003:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510115200 00000100:00100000:2.0:1789181628.453020:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510115200 00000100:00100000:2.0:1789181628.453092:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789181628.453103:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1988c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876092510115200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181628.453216:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1988c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876092510115200:12345-0@lo:400:kworker.0 Request processed in 115us (6642us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181628.453224:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1789181628.453248:0:14419:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789181628.453307:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc19c36c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1876092510115200:0@lo:400:kworker.0 00010000:00010000:0.0:1789181628.620675:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789181628.637444:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 049cbf1a-15b2-4d25-854c-0a3797b8f42e 00000001:00080000:1.0:1789181628.637465:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00010000:00010000:3.0:1789181629.631010:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181629.772838:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181629.772924:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488100224 00000100:00100000:3.0:1789181629.772935:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488100224 00000100:00100000:3.0:1789181629.773009:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9 00000100:00100000:3.0:1789181629.773021:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c01c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:049cbf1a-15b2-4d25-854c-0a3797b8f42e+7:13838:x1876092488100224:12345-192.168.204.32@tcp:41:lfs.0 00000004:00000024:3.0:1789181629.773074:0:14423:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789181629.773164:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c01c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:049cbf1a-15b2-4d25-854c-0a3797b8f42e+7:13838:x1876092488100224:12345-192.168.204.32@tcp:41:lfs.0 Request processed in 145us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181629.773172:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9 00000100:00080000:2.0:1789181629.773876:0:14419:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789181629.784902:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181629.785005:0:15111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488100352 00000100:00100000:1.0:1789181629.785018:0:15111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488100352 00000100:00100000:1.0:1789181629.785221:0:15111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 5 00000100:00100000:1.0:1789181629.785233:0:15111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c01c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:049cbf1a-15b2-4d25-854c-0a3797b8f42e+6:13838:x1876092488100352:12345-192.168.204.32@tcp:13:lfs.0 00002000:00000024:1.0:1789181629.785290:0:15111:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789181629.785404:0:15111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c01c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:049cbf1a-15b2-4d25-854c-0a3797b8f42e+6:13838:x1876092488100352:12345-192.168.204.32@tcp:13:lfs.0 Request processed in 173us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181629.785427:0:15111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 5 00000100:00080000:2.0:1789181629.786811:0:14419:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789181629.789761:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181629.789900:0:15111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488100480 00000100:00100000:2.0:1789181629.789909:0:15111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488100480 00000100:00100000:2.0:1789181629.789981:0:15111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 6 00000100:00100000:2.0:1789181629.789992:0:15111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6e5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:049cbf1a-15b2-4d25-854c-0a3797b8f42e+5:13838:x1876092488100480:12345-192.168.204.32@tcp:13:lfs.0 00002000:00000024:2.0:1789181629.790030:0:15111:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1789181629.790143:0:14419:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789181629.790650:0:15111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6e5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:049cbf1a-15b2-4d25-854c-0a3797b8f42e+5:13838:x1876092488100480:12345-192.168.204.32@tcp:13:lfs.0 Request processed in 659us (898us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181629.790659:0:15111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 6 00000100:00100000:0.0:1789181630.066685:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181630.066983:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488100608 00000100:00100000:1.0:1789181630.066994:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488100608 00000100:00100000:1.0:1789181630.067072:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 92 00000100:00100000:1.0:1789181630.067092:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bbadf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e09b034e-9c19-4cf8-a37d-2da41b05039c+10:13872:x1876092488100608:12345-192.168.204.32@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789181630.067110:0:14417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181630.067129:0:14417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc1baab9a00/0x8f4f7840b2e4252e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f44d expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181630.067157:0:14417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc1baab9a00/0x8f4f7840b2e4252e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f44d expref: 11 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181630.067170:0:14417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc1baab9a00/0x8f4f7840b2e4252e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f44d expref: 11 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181630.067179:0:14417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1baab9a00, rc 0) 00000100:00100000:1.0:1789181630.067239:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bbadf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e09b034e-9c19-4cf8-a37d-2da41b05039c+11:13872:x1876092488100608:12345-192.168.204.32@tcp:101:mount.lustre.0 Request processed in 149us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181630.067246:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 92 00000100:00100000:0.0:1789181630.069944:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181630.070732:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488100736 00000100:00100000:1.0:1789181630.070803:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488100736 00000100:00100000:1.0:1789181630.070854:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 93 00000100:00100000:1.0:1789181630.070863:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bbadf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e09b034e-9c19-4cf8-a37d-2da41b05039c+11:13872:x1876092488100736:12345-192.168.204.32@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789181630.071367:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bbadf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e09b034e-9c19-4cf8-a37d-2da41b05039c+11:13872:x1876092488100736:12345-192.168.204.32@tcp:501:mount.lustre.0 Request processed in 504us (1431us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181630.071385:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 93 00000100:00100000:0.0:1789181630.081620:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181630.081899:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488100864 00000100:00100000:3.0:1789181630.081910:0:14418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488100864 00000100:00100000:3.0:1789181630.081963:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 94 00000100:00100000:3.0:1789181630.081972:0:14418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bbadfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e09b034e-9c19-4cf8-a37d-2da41b05039c+11:13872:x1876092488100864:12345-192.168.204.32@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789181630.082189:0:14418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bbadfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e09b034e-9c19-4cf8-a37d-2da41b05039c+11:13872:x1876092488100864:12345-192.168.204.32@tcp:503:mount.lustre.0 Request processed in 216us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181630.082197:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 94 00000100:00100000:0.0:1789181630.084616:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181630.084686:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488100992 00000100:00100000:1.0:1789181630.084701:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488100992 00000100:00100000:1.0:1789181630.084737:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 95 00000100:00100000:1.0:1789181630.084745:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bbadf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e09b034e-9c19-4cf8-a37d-2da41b05039c+11:13877:x1876092488100992:12345-192.168.204.32@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789181630.084980:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bbadf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e09b034e-9c19-4cf8-a37d-2da41b05039c+11:13877:x1876092488100992:12345-192.168.204.32@tcp:502:llog_process_th.0 Request processed in 234us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181630.084992:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 95 00000100:00100000:2.0:1789181630.098515:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181630.100238:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488101120 00000100:00100000:0.0:1789181630.100255:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488101120 00000100:00100000:0.0:1789181630.100307:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 96 00000100:00100000:0.0:1789181630.100317:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bbade450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e09b034e-9c19-4cf8-a37d-2da41b05039c+11:13877:x1876092488101120:12345-192.168.204.32@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789181630.100686:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bbade450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e09b034e-9c19-4cf8-a37d-2da41b05039c+11:13877:x1876092488101120:12345-192.168.204.32@tcp:502:llog_process_th.0 Request processed in 368us (2177us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181630.100696:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 96 00000100:00100000:2.0:1789181630.105672:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181630.106092:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488101248 00000100:00100000:3.0:1789181630.106102:0:14418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488101248 00000100:00100000:3.0:1789181630.106158:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 97 00000100:00100000:3.0:1789181630.106168:0:14418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bbadd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e09b034e-9c19-4cf8-a37d-2da41b05039c+11:13872:x1876092488101248:12345-192.168.204.32@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789181630.106196:0:14418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181630.106212:0:14418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc1bfa1e800/0x8f4f7840b2e42535 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f477 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181630.106240:0:14418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc1bfa1e800/0x8f4f7840b2e42535 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f477 expref: 12 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181630.106251:0:14418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc1bfa1e800/0x8f4f7840b2e42535 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f477 expref: 12 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181630.106261:0:14418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1bfa1e800, rc 0) 00000100:00100000:3.0:1789181630.106311:0:14418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bbadd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e09b034e-9c19-4cf8-a37d-2da41b05039c+12:13872:x1876092488101248:12345-192.168.204.32@tcp:101:mount.lustre.0 Request processed in 144us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181630.106319:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 97 00000100:00100000:0.0:1789181630.110032:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181630.110214:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488101376 00000100:00100000:1.0:1789181630.110223:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488101376 00000100:00100000:1.0:1789181630.110307:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 98 00000100:00100000:1.0:1789181630.110318:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bbadd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e09b034e-9c19-4cf8-a37d-2da41b05039c+12:13872:x1876092488101376:12345-192.168.204.32@tcp:256:mount.lustre.0 20000000:01000000:1.0:1789181630.110371:0:14417:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1789181630.110393:0:14417:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789181630.110397:0:14417:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1789181630.110400:0:14417:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1789181630.110403:0:14417:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1789181630.112053:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bbadd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e09b034e-9c19-4cf8-a37d-2da41b05039c+12:13872:x1876092488101376:12345-192.168.204.32@tcp:256:mount.lustre.0 Request processed in 1730us (2023us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181630.112065:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 98 00000100:00100000:2.0:1789181630.114751:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181630.114958:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488101504 00000100:00100000:1.0:1789181630.114967:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488101504 00000100:00100000:1.0:1789181630.115055:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 99 00000100:00100000:1.0:1789181630.115078:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bbadd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e09b034e-9c19-4cf8-a37d-2da41b05039c+12:13872:x1876092488101504:12345-192.168.204.32@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789181630.115094:0:14416:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181630.115308:0:14416:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc1baab9600/0x8f4f7840b2e4253c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f47e expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181630.115360:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc1baab9600/0x8f4f7840b2e4253c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f47e expref: 13 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181630.115372:0:14416:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc1baab9600/0x8f4f7840b2e4253c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f47e expref: 13 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181630.115380:0:14416:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1baab9600, rc 0) 00000100:00100000:1.0:1789181630.115430:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bbadd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e09b034e-9c19-4cf8-a37d-2da41b05039c+13:13872:x1876092488101504:12345-192.168.204.32@tcp:101:mount.lustre.0 Request processed in 354us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181630.115437:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 99 00000100:00100000:0.0:1789181630.117140:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181630.117253:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488101632 00000100:00100000:2.0:1789181630.117259:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488101632 00000100:00100000:2.0:1789181630.117299:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 100 00000100:00100000:2.0:1789181630.117308:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bbadcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e09b034e-9c19-4cf8-a37d-2da41b05039c+13:13872:x1876092488101632:12345-192.168.204.32@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789181630.117706:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bbadcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e09b034e-9c19-4cf8-a37d-2da41b05039c+13:13872:x1876092488101632:12345-192.168.204.32@tcp:501:mount.lustre.0 Request processed in 399us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181630.117713:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 100 00000100:00100000:2.0:1789181630.119718:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181630.119824:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488101760 00000100:00100000:1.0:1789181630.119831:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488101760 00000100:00100000:1.0:1789181630.119960:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 101 00000100:00100000:1.0:1789181630.119970:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bbadec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e09b034e-9c19-4cf8-a37d-2da41b05039c+13:13872:x1876092488101760:12345-192.168.204.32@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789181630.120325:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bbadec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e09b034e-9c19-4cf8-a37d-2da41b05039c+13:13872:x1876092488101760:12345-192.168.204.32@tcp:503:mount.lustre.0 Request processed in 356us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181630.120350:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 101 00000100:00100000:0.0:1789181630.124021:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181630.124425:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488101888 00000100:00100000:3.0:1789181630.124436:0:14418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488101888 00000100:00100000:3.0:1789181630.124737:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 102 00000100:00100000:3.0:1789181630.124749:0:14418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bbadc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e09b034e-9c19-4cf8-a37d-2da41b05039c+13:13882:x1876092488101888:12345-192.168.204.32@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789181630.125011:0:14418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bbadc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e09b034e-9c19-4cf8-a37d-2da41b05039c+13:13882:x1876092488101888:12345-192.168.204.32@tcp:502:llog_process_th.0 Request processed in 262us (998us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181630.125019:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 102 00000100:00100000:0.0:1789181630.127506:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181630.127724:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488102016 00000100:00100000:1.0:1789181630.127732:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488102016 00000100:00100000:1.0:1789181630.127784:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 103 00000100:00100000:1.0:1789181630.127794:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bbaddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e09b034e-9c19-4cf8-a37d-2da41b05039c+13:13882:x1876092488102016:12345-192.168.204.32@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789181630.129546:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bbaddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e09b034e-9c19-4cf8-a37d-2da41b05039c+13:13882:x1876092488102016:12345-192.168.204.32@tcp:502:llog_process_th.0 Request processed in 1746us (2040us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181630.129580:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 103 00000100:00100000:0.0:1789181630.145850:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181630.147515:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488102144 00000100:00100000:2.0:1789181630.147528:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488102144 00000100:00100000:3.0:1789181630.147720:0:15740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 10 00000100:00100000:3.0:1789181630.147730:0:15740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c01c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2350:x1876092488102144:12345-192.168.204.32@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789181630.147760:0:15740:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from f95d2205-e877-434a-82a2-5130e9e350fc@192.168.204.32@tcp t0 exp 0000000000000000 cur 522 last 0 00000020:00000080:3.0:1789181630.147802:0:15740:0:(genops.c:1384:class_connect()) connect: client f95d2205-e877-434a-82a2-5130e9e350fc, cookie 0x8f4f7840b2e42543 00000004:00100000:3.0:1789181630.147833:0:15740:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1789181630.147966:0:15740:0:(import.c:65:import_set_state_nolock()) ffff9dc1b66e3800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789181630.148040:0:15740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c01c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f95d2205-e877-434a-82a2-5130e9e350fc+6:2350:x1876092488102144:12345-192.168.204.32@tcp:38:mount.lustre.0 Request processed in 310us (2198us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181630.148048:0:15740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 10 00000100:00100000:0.0:1789181630.149745:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181630.149784:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181630.149815:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181630.149893:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488102528 00000100:00100000:3.0:1789181630.149901:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488102528 00000100:00100000:3.0:1789181630.149946:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 17 00000100:00100000:3.0:1789181630.149955:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c01c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:049cbf1a-15b2-4d25-854c-0a3797b8f42e+7:2351:x1876092488102528:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:3.0:1789181630.150014:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c01c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:049cbf1a-15b2-4d25-854c-0a3797b8f42e+7:2351:x1876092488102528:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 61us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181630.150022:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 17 00000100:00100000:2.0:1789181630.150465:0:15109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488102784 00000100:00100000:2.0:1789181630.150471:0:15109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488102784 00000100:00100000:2.0:1789181630.150504:0:15109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488102656 00000100:00100000:2.0:1789181630.150507:0:15109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488102656 00000100:00100000:2.0:1789181630.150520:0:15109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 3 00000100:00100000:2.0:1789181630.150526:0:15109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c01c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:049cbf1a-15b2-4d25-854c-0a3797b8f42e+5:2351:x1876092488102784:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:2.0:1789181630.150575:0:15109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c01c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:049cbf1a-15b2-4d25-854c-0a3797b8f42e+5:2351:x1876092488102784:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 48us (789us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181630.150581:0:15109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 3 00000100:00100000:2.0:1789181630.150604:0:15109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 4 00000100:00100000:2.0:1789181630.150611:0:15109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c01c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:049cbf1a-15b2-4d25-854c-0a3797b8f42e+6:2351:x1876092488102656:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:2.0:1789181630.150645:0:15109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c01c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:049cbf1a-15b2-4d25-854c-0a3797b8f42e+6:2351:x1876092488102656:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 35us (829us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181630.150652:0:15109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 4 00000100:00100000:0.0:1789181630.155799:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181630.155886:0:15740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488102272 00000100:00100000:3.0:1789181630.155896:0:15740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488102272 00000100:00100000:3.0:1789181630.155968:0:15740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 11 00000100:00100000:3.0:1789181630.155978:0:15740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c01c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f95d2205-e877-434a-82a2-5130e9e350fc+6:0:x1876092488102272:12345-192.168.204.32@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789181630.156011:0:15740:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789181630.156086:0:15740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c01c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f95d2205-e877-434a-82a2-5130e9e350fc+6:0:x1876092488102272:12345-192.168.204.32@tcp:41:mount.lustre.0 Request processed in 108us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181630.156093:0:15740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 11 00000100:00080000:0.0:1789181630.156686:0:14419:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789181630.161203:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181630.161326:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488102400 00000100:00100000:3.0:1789181630.161369:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488102400 00000100:00100000:3.0:1789181630.161418:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 12 00000100:00100000:3.0:1789181630.161427:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c36c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f95d2205-e877-434a-82a2-5130e9e350fc+6:13872:x1876092488102400:12345-192.168.204.32@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789181630.161469:0:14423:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789181630.161538:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c36c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f95d2205-e877-434a-82a2-5130e9e350fc+6:13872:x1876092488102400:12345-192.168.204.32@tcp:41:mount.lustre.0 Request processed in 111us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181630.161574:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 12 00000100:00100000:1.0:1789181630.167686:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181630.167814:0:15740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488102912 00000100:00100000:3.0:1789181630.167824:0:15740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488102912 00000100:00100000:3.0:1789181630.167879:0:15740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 13 00000100:00100000:3.0:1789181630.167890:0:15740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6e5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f95d2205-e877-434a-82a2-5130e9e350fc+6:13872:x1876092488102912:12345-192.168.204.32@tcp:40:mount.lustre.0 00000100:00100000:3.0:1789181630.167973:0:15740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6e5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f95d2205-e877-434a-82a2-5130e9e350fc+6:13872:x1876092488102912:12345-192.168.204.32@tcp:40:mount.lustre.0 Request processed in 85us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181630.167981:0:15740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 13 00000100:00100000:2.0:1789181630.170646:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181630.170738:0:15109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488103040 00000100:00100000:0.0:1789181630.170746:0:15109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488103040 00000100:00100000:0.0:1789181630.170789:0:15109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9 00000100:00100000:0.0:1789181630.170797:0:15109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c36ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2350:x1876092488103040:12345-192.168.204.32@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789181630.170824:0:15109:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from f95d2205-e877-434a-82a2-5130e9e350fc@192.168.204.32@tcp t0 exp 0000000000000000 cur 522 last 0 00000020:00000080:0.0:1789181630.170857:0:15109:0:(genops.c:1384:class_connect()) connect: client f95d2205-e877-434a-82a2-5130e9e350fc, cookie 0x8f4f7840b2e4254a 00002000:00100000:0.0:1789181630.170868:0:15109:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f95d2205-e877-434a-82a2-5130e9e350fc/ffff9dc185296800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789181630.170879:0:15109:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789181630.170988:0:15109:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789181630.171018:0:15109:0:(import.c:65:import_set_state_nolock()) ffff9dc185294800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789181630.171080:0:15109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c36ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f95d2205-e877-434a-82a2-5130e9e350fc+6:2350:x1876092488103040:12345-192.168.204.32@tcp:8:mount.lustre.0 Request processed in 282us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181630.171087:0:15109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9 00000100:00100000:0.0:1789181630.173743:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181630.173838:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488103296 00000100:00100000:1.0:1789181630.173846:0:14427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488103296 00000100:00100000:1.0:1789181630.173894:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1 00000100:00100000:1.0:1789181630.173904:0:14427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c01c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f95d2205-e877-434a-82a2-5130e9e350fc+6:13872:x1876092488103296:12345-192.168.204.32@tcp:33:mount.lustre.0 00000004:00200000:1.0:1789181630.173973:0:14427:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1789181630.174086:0:14427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c01c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f95d2205-e877-434a-82a2-5130e9e350fc+6:13872:x1876092488103296:12345-192.168.204.32@tcp:33:mount.lustre.0 Request processed in 183us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181630.174095:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1 00000100:00100000:1.0:1789181630.177898:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181630.180217:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488103168 00000100:00100000:2.0:1789181630.180231:0:15106:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488103168 00000100:00100000:2.0:1789181630.180288:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 10 00000100:00100000:2.0:1789181630.180297:0:15106:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6e5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2350:x1876092488103168:12345-192.168.204.32@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789181630.180362:0:15106:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from f95d2205-e877-434a-82a2-5130e9e350fc@192.168.204.32@tcp t0 exp 0000000000000000 cur 522 last 0 00000020:00000080:2.0:1789181630.180396:0:15106:0:(genops.c:1384:class_connect()) connect: client f95d2205-e877-434a-82a2-5130e9e350fc, cookie 0x8f4f7840b2e42551 00002000:00100000:2.0:1789181630.180408:0:15106:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f95d2205-e877-434a-82a2-5130e9e350fc/ffff9dc1a7d6b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789181630.180419:0:15106:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789181630.180701:0:15106:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789181630.180730:0:15106:0:(import.c:65:import_set_state_nolock()) ffff9dc1a7d6c800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789181630.180799:0:15106:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6e5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f95d2205-e877-434a-82a2-5130e9e350fc+6:2350:x1876092488103168:12345-192.168.204.32@tcp:8:mount.lustre.0 Request processed in 502us (2909us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181630.180807:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 10 00000100:00100000:1.0:1789181630.299862:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181630.299968:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488103424 00000100:00100000:3.0:1789181630.299978:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488103424 00000100:00100000:3.0:1789181630.300084:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 14 00000100:00100000:3.0:1789181630.300095:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c01b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f95d2205-e877-434a-82a2-5130e9e350fc+6:13903:x1876092488103424:12345-192.168.204.32@tcp:101:mkdir.0 00010000:00010000:3.0:1789181630.300131:0:14423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181630.300154:0:14423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e42558 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f4a8 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181630.300218:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f800/0x8f4f7840b2e4255f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181630.300231:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f800/0x8f4f7840b2e4255f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181630.300247:0:14423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f800/0x8f4f7840b2e4255f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789181630.300281:0:14423:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789181630.300285:0:14423:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789181630.300358:0:14423:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f800/0x8f4f7840b2e4255f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181630.300383:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fc00/0x8f4f7840b2e42558 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f4a8 expref: 8 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181630.300402:0:14423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f800/0x8f4f7840b2e4255f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f4a8 expref: 7 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181630.300411:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc18a6c2500) 00010000:00010000:3.0:1789181630.300414:0:14423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789181630.300418:0:14423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1bfa1f800, rc 0) 00000100:00100000:3.0:1789181630.300477:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c01b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f95d2205-e877-434a-82a2-5130e9e350fc+7:13903:x1876092488103424:12345-192.168.204.32@tcp:101:mkdir.0 Request processed in 384us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181630.300484:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 14 00010000:00010000:2.0:1789181630.656406:0:16126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789181631.571073:0:6718:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f95d2205-e877-434a-82a2-5130e9e350fc 00000001:00100000:3.0:1789181631.571087:0:6718:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 049cbf1a-15b2-4d25-854c-0a3797b8f42e 00010000:00010000:2.0:1789181631.686912:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789181632.511704:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc19c36f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876092510115328:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789181632.511781:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181632.512650:0:15110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510115328 00000100:00100000:2.0:1789181632.512660:0:15110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510115328 00000100:00100000:2.0:1789181632.512726:0:15110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789181632.512735:0:15110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1988c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876092510115328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789181632.512770:0:15110:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789181632.512846:0:15110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1988c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876092510115328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (1064us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181632.512871:0:15110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789181632.514594:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc19c36f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876092510115328:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789181632.516217:0:14419:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:2.0:1789181632.582801:0:5865:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 049cbf1a-15b2-4d25-854c-0a3797b8f42e 00000001:00100000:2.0:1789181632.582818:0:5865:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f95d2205-e877-434a-82a2-5130e9e350fc 00010000:00010000:3.0:1789181632.704405:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789181633.534541:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789181633.534563:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c01b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876092510115456:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789181633.534627:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181633.534829:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc19c36c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:486954f1-c2e6-402a-b3c8-096af476560c:3305:1876092510115584:0@lo:400:kworker.0 00000100:00100000:2.0:1789181633.534867:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181633.534894:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc19c36fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1876092510116096:0@lo:400:kworker.0 00000100:00100000:2.0:1789181633.534918:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181633.534937:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789181633.534942:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc19c36df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510115712:0@lo:400:kworker.0 00000100:00100000:2.0:1789181633.534966:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181633.534991:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc19c36f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1876092510115968:0@lo:400:kworker.0 00000100:00100000:2.0:1789181633.535014:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181633.535030:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789181633.535035:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc19c36f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876092510115840:0@lo:400:kworker.0 00000100:00100000:2.0:1789181633.535052:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181633.535079:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510115584 00000100:00100000:2.0:1789181633.535087:0:14418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510115584 00000100:00100000:2.0:1789181633.535124:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789181633.535132:0:14418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bbadc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:486954f1-c2e6-402a-b3c8-096af476560c+19:3305:x1876092510115584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181633.535179:0:14418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bbadc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:486954f1-c2e6-402a-b3c8-096af476560c+19:3305:x1876092510115584:12345-0@lo:400:kworker.0 Request processed in 47us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181633.535187:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789181633.535217:0:15740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510116096 00000100:00100000:2.0:1789181633.535221:0:15740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510116096 00000100:00100000:2.0:1789181633.535264:0:15740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510115968 00000100:00100000:2.0:1789181633.535268:0:15740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510115968 00000100:00100000:2.0:1789181633.535282:0:15740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510115840 00000100:00100000:2.0:1789181633.535284:0:15740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510115840 00000100:00100000:2.0:1789181633.535301:0:15740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789181633.535307:0:15740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c36d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876092510116096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181633.535368:0:15740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c36d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876092510116096:12345-0@lo:400:kworker.0 Request processed in 61us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181633.535374:0:15740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789181633.535387:0:15740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789181633.535393:0:15740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0833d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876092510115968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181633.535423:0:15740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0833d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876092510115968:12345-0@lo:400:kworker.0 Request processed in 30us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181633.535429:0:15740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789181633.535441:0:15740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789181633.535446:0:15740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0833d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876092510115840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181633.535472:0:15740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0833d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876092510115840:12345-0@lo:400:kworker.0 Request processed in 26us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181633.535478:0:15740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789181633.535508:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510115712 00000100:00100000:2.0:1789181633.535512:0:15107:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510115712 00000100:00100000:2.0:1789181633.535537:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789181633.535543:0:15107:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c36e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510115712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181633.535573:0:15107:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c36e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510115712:12345-0@lo:400:kworker.0 Request processed in 31us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181633.535579:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789181633.535623:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc19c36f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876092510115840:0@lo:400:kworker.0 00000100:00100000:2.0:1789181633.535644:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc19c36f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1876092510115968:0@lo:400:kworker.0 00000100:00100000:2.0:1789181633.535672:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc19c36df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510115712:0@lo:400:kworker.0 00000100:00100000:2.0:1789181633.535679:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc19c36c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:486954f1-c2e6-402a-b3c8-096af476560c:3305:1876092510115584:0@lo:400:kworker.0 00000100:00100000:2.0:1789181633.535686:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc19c36fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1876092510116096:0@lo:400:kworker.0 00000100:00080000:0.0:1789181633.535753:0:14419:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789181633.535814:0:15110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510115456 00000100:00100000:1.0:1789181633.535819:0:15110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510115456 00000100:00100000:1.0:1789181633.535863:0:15110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789181633.535871:0:15110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c01c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876092510115456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789181633.535897:0:15110:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789181633.535934:0:15110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c01c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876092510115456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (1307us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181633.535940:0:15110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1789181633.535983:0:14419:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789181633.536001:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1789181633.536024:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c01b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876092510115456:0@lo:13:osp-pre-1-0.0 00000001:00100000:0.0:1789181633.563372:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f95d2205-e877-434a-82a2-5130e9e350fc 00000001:02000400:2.0:1789181633.725751:0:16388:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1789181633.726611:0:16126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789181634.047142:0:14458:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789181634.750487:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181635.681281:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181635.681327:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181635.681372:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181635.681411:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181635.681430:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181635.681461:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181635.681489:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181635.681514:0:15109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488103936 00000100:00100000:1.0:1789181635.681523:0:15109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488103936 00000100:00100000:1.0:1789181635.681573:0:15109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488104192 00000100:00100000:1.0:1789181635.681576:0:15109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488104192 00000100:00100000:1.0:1789181635.681590:0:15109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488103808 00000100:00100000:1.0:1789181635.681592:0:15109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488103808 00000100:00100000:1.0:1789181635.681607:0:15109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488104320 00000100:00100000:1.0:1789181635.681609:0:15109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488104320 00000100:00100000:1.0:1789181635.681625:0:15109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 6 00000100:00100000:1.0:1789181635.681634:0:15109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c01b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:049cbf1a-15b2-4d25-854c-0a3797b8f42e+5:2354:x1876092488103936:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:1.0:1789181635.681703:0:15109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c01b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:049cbf1a-15b2-4d25-854c-0a3797b8f42e+5:2354:x1876092488103936:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 70us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181635.681711:0:15109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 6 00000100:00100000:1.0:1789181635.681727:0:15109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 7 00000100:00100000:1.0:1789181635.681734:0:15109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c01b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f95d2205-e877-434a-82a2-5130e9e350fc+5:2354:x1876092488104192:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:1.0:1789181635.681756:0:15109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c01b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f95d2205-e877-434a-82a2-5130e9e350fc+5:2354:x1876092488104192:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 24us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181635.681762:0:15109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 7 00000100:00100000:1.0:1789181635.681774:0:15109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 8 00000100:00100000:1.0:1789181635.681780:0:15109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c01b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:049cbf1a-15b2-4d25-854c-0a3797b8f42e+5:2354:x1876092488103808:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:1.0:1789181635.681799:0:15109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c01b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:049cbf1a-15b2-4d25-854c-0a3797b8f42e+5:2354:x1876092488103808:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 20us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181635.681816:0:15109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 8 00000100:00100000:1.0:1789181635.681828:0:15109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9 00000100:00100000:1.0:1789181635.681847:0:15109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c01b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f95d2205-e877-434a-82a2-5130e9e350fc+5:2354:x1876092488104320:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:1.0:1789181635.681873:0:15109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c01b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f95d2205-e877-434a-82a2-5130e9e350fc+5:2354:x1876092488104320:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 41us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181635.681879:0:15109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9 00000100:00100000:1.0:1789181635.681898:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488103552 00000100:00100000:1.0:1789181635.681901:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488103552 00000100:00100000:1.0:1789181635.681925:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 105 00000100:00100000:1.0:1789181635.681932:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bbade850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e09b034e-9c19-4cf8-a37d-2da41b05039c+13:2354:x1876092488103552:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:1.0:1789181635.681969:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bbade850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e09b034e-9c19-4cf8-a37d-2da41b05039c+13:2354:x1876092488103552:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 37us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181635.681975:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 105 00000100:00100000:1.0:1789181635.682005:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488103680 00000100:00100000:1.0:1789181635.682008:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488103680 00000100:00100000:1.0:1789181635.682037:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488104064 00000100:00100000:1.0:1789181635.682039:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488104064 00000100:00100000:1.0:1789181635.682057:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 21 00000100:00100000:1.0:1789181635.682062:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c01b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:049cbf1a-15b2-4d25-854c-0a3797b8f42e+6:2354:x1876092488103680:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:1.0:1789181635.682090:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c01b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:049cbf1a-15b2-4d25-854c-0a3797b8f42e+6:2354:x1876092488103680:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 27us (825us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181635.682095:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 21 00000100:00100000:1.0:1789181635.682110:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 22 00000100:00100000:1.0:1789181635.682116:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c01b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f95d2205-e877-434a-82a2-5130e9e350fc+6:2354:x1876092488104064:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:1.0:1789181635.682151:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c01b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f95d2205-e877-434a-82a2-5130e9e350fc+6:2354:x1876092488104064:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 35us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181635.682157:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 22 00000100:00080000:1.0:1789181635.682174:0:14419:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789181635.682178:0:14419:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789181635.682179:0:14419:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789181635.776129:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789181636.798699:0:16126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181637.634264:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789181637.634287:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0833d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510116224:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789181637.634384:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181637.634469:0:15110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510116224 00000100:00100000:2.0:1789181637.634478:0:15110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510116224 00000100:00100000:2.0:1789181637.634540:0:15110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789181637.634551:0:15110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0833d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510116224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789181637.634589:0:15110:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789181637.634638:0:15110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0833d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510116224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181637.634646:0:15110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1789181637.634673:0:14419:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789181637.634723:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc0833d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510116224:0@lo:13:osp-pre-0-0.0 00000020:00000080:1.0:1789181637.805718:0:16536:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe80ea0620 20000000:00000080:1.0:1789181637.805735:0:16536:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9dc0813ecc00 uarg=0000000000000000 20000000:01000000:1.0:1789181637.805769:0:16536:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789181637.805775:0:16536:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789181637.805780:0:16536:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1789181637.806778:0:16537:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:1.0:1789181637.806946:0:16536:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1789181637.813984:0:16536:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789181637.814018:0:16536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dc1baab8c00/0x8f4f7840b2e42566 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181637.814038:0:16536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dc18151a800/0x8f4f7840b2e4225d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e42256 expref: 18 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181637.814046:0:16536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dc1c0259600/0x8f4f7840b2e422aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e422a3 expref: 18 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181637.814054:0:16536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dc1c0258400/0x8f4f7840b2e423e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e423de expref: 18 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181637.814064:0:16536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dc1ba784a00/0x8f4f7840b2e42504 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f41c expref: 12 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181637.814090:0:16536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dc1baab9600/0x8f4f7840b2e4253c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f47e expref: 12 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181637.814098:0:16536:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9dc1baab8c00/0x8f4f7840b2e42566 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181637.814138:0:16536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dc1baab9600/0x8f4f7840b2e4253c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f47e expref: 12 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181637.814151:0:16536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dc1baab9600/0x8f4f7840b2e4253c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f47e expref: 12 pid: 14416 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181637.814166:0:16536:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c01b1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16536:1876092510116352:192.168.204.32@tcp:104: 00010000:00010000:1.0:1789181637.814271:0:16536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dc1ba784a00/0x8f4f7840b2e42504 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f41c expref: 12 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181637.814280:0:16536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dc1ba784a00/0x8f4f7840b2e42504 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f41c expref: 12 pid: 14418 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181637.814288:0:16536:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c01b0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16536:1876092510116480:192.168.204.32@tcp:104: 00010000:00010000:1.0:1789181637.814314:0:16536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dc1c0258400/0x8f4f7840b2e423e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8f4f7840b2e423de expref: 18 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181637.814321:0:16536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dc1c0258400/0x8f4f7840b2e423e5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8f4f7840b2e423de expref: 18 pid: 14416 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181637.814356:0:16536:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c01b1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16536:1876092510116608:0@lo:104: 00000100:00100000:1.0:1789181637.814394:0:16536:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789181637.814460:0:16536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dc1c0259600/0x8f4f7840b2e422aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8f4f7840b2e422a3 expref: 18 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181637.814468:0:16536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dc1c0259600/0x8f4f7840b2e422aa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8f4f7840b2e422a3 expref: 18 pid: 14418 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181637.814476:0:16536:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c01b2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16536:1876092510116736:0@lo:104: 00000100:00100000:1.0:1789181637.814498:0:16536:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789181637.814520:0:16536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dc18151a800/0x8f4f7840b2e4225d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8f4f7840b2e42256 expref: 18 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181637.814527:0:16536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dc18151a800/0x8f4f7840b2e4225d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8f4f7840b2e42256 expref: 18 pid: 14417 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181637.814534:0:16536:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c01b3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16536:1876092510116864:0@lo:104: 00000100:00100000:1.0:1789181637.814559:0:16536:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181637.814570:0:16536:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1879a6d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789181637.815114:0:14407:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789181637.815127:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510116608 00000100:00100000:3.0:1789181637.815133:0:14407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510116608 00000100:00100000:3.0:1789181637.815167:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510116736 00000100:00100000:3.0:1789181637.815170:0:14407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510116736 00000100:00100000:3.0:1789181637.815177:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510116864 00000100:00100000:3.0:1789181637.815180:0:14407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510116864 00000100:00100000:3.0:1789181637.815202:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789181637.815282:0:14407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c01b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:486954f1-c2e6-402a-b3c8-096af476560c+5:16536:x1876092510116608:12345-0@lo:104: 00010000:00010000:3.0:1789181637.815296:0:14407:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1e200/0x8f4f7840b2e423de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f4f7840b2e423e5 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181637.815379:0:14407:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789181637.815385:0:14407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c01b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:486954f1-c2e6-402a-b3c8-096af476560c+5:16536:x1876092510116608:12345-0@lo:104: Request processed in 107us (991us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181637.815387:0:16536:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c01b1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16536:1876092510116608:0@lo:104: 00000100:00100000:3.0:1789181637.815392:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789181637.815424:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789181637.815432:0:14407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c01b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:486954f1-c2e6-402a-b3c8-096af476560c+4:16536:x1876092510116736:12345-0@lo:104: 00010000:00010000:3.0:1789181637.815440:0:14407:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.132@tcp lock: ffff9dc18151be00/0x8f4f7840b2e422a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f4f7840b2e422aa expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181637.816079:0:14407:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789181637.816086:0:14407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c01b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:486954f1-c2e6-402a-b3c8-096af476560c+4:16536:x1876092510116736:12345-0@lo:104: Request processed in 655us (1587us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181637.816093:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789181637.816110:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789181637.816116:0:14407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1ba4a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:486954f1-c2e6-402a-b3c8-096af476560c+3:16536:x1876092510116864:12345-0@lo:104: 00010000:00010000:3.0:1789181637.816125:0:14407:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.132@tcp lock: ffff9dc1c0259000/0x8f4f7840b2e42256 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f4f7840b2e4225d expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181637.816163:0:14407:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789181637.816168:0:14407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1ba4a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:486954f1-c2e6-402a-b3c8-096af476560c+3:16536:x1876092510116864:12345-0@lo:104: Request processed in 52us (1608us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181637.816173:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1789181637.816275:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789181637.816289:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1e200/0x8f4f7840b2e423de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f4f7840b2e423e5 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181637.816296:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1bfa1e200 already unused, calling callback (ffffffffc1b45c20) 10000000:00010000:3.0:1789181637.816300:0:14411:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1e200/0x8f4f7840b2e423de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8f4f7840b2e423e5 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181637.816308:0:14411:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1e200/0x8f4f7840b2e423de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8f4f7840b2e423e5 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789181637.816316:0:14411:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1e200/0x8f4f7840b2e423de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8f4f7840b2e423e5 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789181637.816322:0:14411:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789181637.816511:0:14411:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1e200/0x8f4f7840b2e423de lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e423e5 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181637.816518:0:14411:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789181637.816540:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1e200/0x8f4f7840b2e423de lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e423e5 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181637.816547:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1e200/0x8f4f7840b2e423de lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e423e5 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181637.816558:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789181637.816561:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.132@tcp lock: ffff9dc18151be00/0x8f4f7840b2e422a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f4f7840b2e422aa expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181637.816566:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc18151be00 already unused, calling callback (ffffffffc1b45c20) 10000000:00010000:3.0:1789181637.816569:0:14411:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.132@tcp lock: ffff9dc18151be00/0x8f4f7840b2e422a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8f4f7840b2e422aa expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181637.816832:0:14411:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.132@tcp lock: ffff9dc18151be00/0x8f4f7840b2e422a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8f4f7840b2e422aa expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789181637.816842:0:14411:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.132@tcp lock: ffff9dc18151be00/0x8f4f7840b2e422a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8f4f7840b2e422aa expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789181637.816847:0:14411:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789181637.817089:0:14411:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.132@tcp lock: ffff9dc18151be00/0x8f4f7840b2e422a3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e422aa expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181637.817097:0:14411:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789181637.817105:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.132@tcp lock: ffff9dc18151be00/0x8f4f7840b2e422a3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e422aa expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181637.817112:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.132@tcp lock: ffff9dc18151be00/0x8f4f7840b2e422a3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e422aa expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181637.817121:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789181637.817125:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.132@tcp lock: ffff9dc1c0259000/0x8f4f7840b2e42256 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8f4f7840b2e4225d expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181637.817130:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1c0259000 already unused, calling callback (ffffffffc1b45c20) 10000000:00010000:3.0:1789181637.817133:0:14411:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.132@tcp lock: ffff9dc1c0259000/0x8f4f7840b2e42256 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8f4f7840b2e4225d expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181637.817140:0:14411:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.132@tcp lock: ffff9dc1c0259000/0x8f4f7840b2e42256 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8f4f7840b2e4225d expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789181637.817145:0:14411:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.132@tcp lock: ffff9dc1c0259000/0x8f4f7840b2e42256 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8f4f7840b2e4225d expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789181637.817157:0:14411:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789181637.817172:0:14411:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.132@tcp lock: ffff9dc1c0259000/0x8f4f7840b2e42256 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e4225d expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181637.817177:0:14411:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789181637.817193:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.132@tcp lock: ffff9dc1c0259000/0x8f4f7840b2e42256 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e4225d expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181637.817199:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.132@tcp lock: ffff9dc1c0259000/0x8f4f7840b2e42256 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8f4f7840b2e4225d expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181637.817283:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181637.817285:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181637.817287:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181637.817294:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181637.817300:0:16126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789181637.817322:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1988c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:486954f1-c2e6-402a-b3c8-096af476560c:3303:1876092510116992:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789181637.817390:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181637.817440:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789181637.817517:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1988c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:486954f1-c2e6-402a-b3c8-096af476560c:3303:1876092510117120:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789181637.817540:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181637.817570:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1988c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:486954f1-c2e6-402a-b3c8-096af476560c:3305:1876092510117248:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789181637.817824:0:16536:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c01b2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16536:1876092510116736:0@lo:104: 00000100:00100000:0.0:1789181637.817836:0:16536:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c01b3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16536:1876092510116864:0@lo:104: 00000100:00100000:3.0:1789181637.817868:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181637.818163:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510116992 00000100:00100000:3.0:1789181637.818170:0:14410:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510116992 00000100:00100000:0.0:1789181637.818276:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510117120 00000100:00100000:0.0:1789181637.818280:0:14408:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510117120 00010000:00010000:0.0:1789181637.818297:0:14408:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dc1c0259600/0x8f4f7840b2e422aa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f4f7840b2e422a3 expref: 20 pid: 14418 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181637.818311:0:14410:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dc1c0258400/0x8f4f7840b2e423e5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f4f7840b2e423de expref: 19 pid: 14416 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181637.818316:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510117248 00000100:00100000:0.0:1789181637.818319:0:14408:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510117248 00010000:00010000:0.0:1789181637.818355:0:14408:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dc18151a800/0x8f4f7840b2e4225d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f4f7840b2e42256 expref: 21 pid: 14417 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181637.818368:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789181637.818378:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789181637.818385:0:14410:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1988c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:486954f1-c2e6-402a-b3c8-096af476560c+21:3303:x1876092510116992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789181637.818399:0:14410:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789181637.818414:0:14410:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dc1c0258400/0x8f4f7840b2e423e5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f4f7840b2e423de expref: 21 pid: 14416 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181637.818424:0:14410:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dc1c0258400/0x8f4f7840b2e423e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8f4f7840b2e423de expref: 21 pid: 14416 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181637.818440:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc1c0258400/0x8f4f7840b2e423e5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8f4f7840b2e423de expref: 21 pid: 14416 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181637.818457:0:14408:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1988c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:486954f1-c2e6-402a-b3c8-096af476560c+21:3303:x1876092510117120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789181637.818465:0:14408:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789181637.818469:0:14408:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dc1c0259600/0x8f4f7840b2e422aa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f4f7840b2e422a3 expref: 21 pid: 14418 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181637.818477:0:14408:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dc1c0259600/0x8f4f7840b2e422aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8f4f7840b2e422a3 expref: 21 pid: 14418 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181637.818487:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc1c0259600/0x8f4f7840b2e422aa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8f4f7840b2e422a3 expref: 21 pid: 14418 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181637.818499:0:14408:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789181637.818516:0:14410:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789181637.818546:0:14410:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1988c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:486954f1-c2e6-402a-b3c8-096af476560c+19:3303:x1876092510116992:12345-0@lo:103:ldlm_bl.0 Request processed in 163us (1156us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181637.818546:0:14408:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1988c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:486954f1-c2e6-402a-b3c8-096af476560c+19:3303:x1876092510117120:12345-0@lo:103:ldlm_bl.0 Request processed in 171us (1005us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181637.818553:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789181637.818568:0:14410:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1789181637.818575:0:14410:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1789181637.818586:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1988c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:486954f1-c2e6-402a-b3c8-096af476560c:3303:1876092510117120:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789181637.818595:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1988c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:486954f1-c2e6-402a-b3c8-096af476560c:3303:1876092510116992:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789181637.819653:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789181637.819707:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789181637.819718:0:14409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfab3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:486954f1-c2e6-402a-b3c8-096af476560c+18:3305:x1876092510117248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789181637.819729:0:14409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789181637.819736:0:14409:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dc18151a800/0x8f4f7840b2e4225d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8f4f7840b2e42256 expref: 18 pid: 14417 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181637.819773:0:14409:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dc18151a800/0x8f4f7840b2e4225d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8f4f7840b2e42256 expref: 17 pid: 14417 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181637.819792:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc18151a800/0x8f4f7840b2e4225d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8f4f7840b2e42256 expref: 17 pid: 14417 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181637.819804:0:14409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789181637.819862:0:14409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfab3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:486954f1-c2e6-402a-b3c8-096af476560c+16:3305:x1876092510117248:12345-0@lo:103:ldlm_bl.0 Request processed in 147us (1993us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181637.819869:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789181637.819963:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1988c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:486954f1-c2e6-402a-b3c8-096af476560c:3305:1876092510117248:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789181637.822769:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181637.832694:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181637.832748:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181637.832840:0:16536:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c01b1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16536:1876092510116352:192.168.204.32@tcp:104: 00000100:00100000:0.0:1789181637.832851:0:16536:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c01b0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16536:1876092510116480:192.168.204.32@tcp:104: 00010000:00010000:0.0:1789181637.832897:0:16536:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9dc1baab8c00/0x8f4f7840b2e42566 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181637.832963:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488104448 00000100:00100000:3.0:1789181637.832969:0:14409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488104448 00010000:00010000:3.0:1789181637.833004:0:14409:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dc1baab9600/0x8f4f7840b2e4253c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f47e expref: 13 pid: 14416 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181637.833037:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488104576 00000100:00100000:3.0:1789181637.833040:0:14409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488104576 00010000:00010000:3.0:1789181637.833053:0:14409:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dc1ba784a00/0x8f4f7840b2e42504 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f41c expref: 14 pid: 14418 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181637.833099:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 7 00000100:00100000:3.0:1789181637.833107:0:14409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c01b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e09b034e-9c19-4cf8-a37d-2da41b05039c+14:2354:x1876092488104448:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789181637.833122:0:14409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789181637.833128:0:14409:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dc1baab9600/0x8f4f7840b2e4253c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f47e expref: 14 pid: 14416 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181637.833139:0:14409:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dc1baab9600/0x8f4f7840b2e4253c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f47e expref: 14 pid: 14416 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181637.833157:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc1baab9600/0x8f4f7840b2e4253c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f47e expref: 14 pid: 14416 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181637.833173:0:14409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789181637.833225:0:14409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c01b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e09b034e-9c19-4cf8-a37d-2da41b05039c+13:2354:x1876092488104448:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 118us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181637.833232:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 7 00000100:00100000:3.0:1789181637.833249:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 8 00000100:00100000:3.0:1789181637.833254:0:14409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c01b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e09b034e-9c19-4cf8-a37d-2da41b05039c+12:2353:x1876092488104576:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789181637.833260:0:14409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789181637.833264:0:14409:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dc1ba784a00/0x8f4f7840b2e42504 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f41c expref: 12 pid: 14418 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181637.833273:0:14409:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dc1ba784a00/0x8f4f7840b2e42504 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f41c expref: 12 pid: 14418 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181637.833282:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc1ba784a00/0x8f4f7840b2e42504 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f41c expref: 12 pid: 14418 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181637.833298:0:14409:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9dc1baab8c00/0x8f4f7840b2e42566 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181637.833306:0:14409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc1baab8c00/0x8f4f7840b2e42566 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181637.833321:0:14409:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dc1baab8c00/0x8f4f7840b2e42566 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181637.833327:0:14409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dc1baab8c00/0x8f4f7840b2e42566 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181637.833366:0:14409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dc1baab8c00/0x8f4f7840b2e42566 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181637.833372:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dc1baab8c00/0x8f4f7840b2e42566 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181637.833379:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1baab8c00 already unused, calling callback (ffffffffc152f9b0) 00010000:00010000:3.0:1789181637.833384:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dc1baab8c00/0x8f4f7840b2e42566 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181637.833392:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dc1baab8c00/0x8f4f7840b2e42566 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181637.833404:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dc1baab8c00/0x8f4f7840b2e42566 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181637.833423:0:14409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789181637.833453:0:14409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c01b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e09b034e-9c19-4cf8-a37d-2da41b05039c+11:2353:x1876092488104576:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 198us (704us total) trans 0 rc 0/0 00010000:00010000:0.0:1789181637.833660:0:16536:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9dc1baab8c00/0x8f4f7840b2e42566 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181637.833668:0:16536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dc1baab8c00/0x8f4f7840b2e42566 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181637.833674:0:16536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dc1baab8c00/0x8f4f7840b2e42566 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181637.834515:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 8 00000100:00100000:2.0:1789181638.654635:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0833d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876092510117632:0@lo:400:kworker.0 00000100:00100000:2.0:1789181638.654712:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181638.654773:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789181638.654794:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0833d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876092510117504:0@lo:400:kworker.0 00000100:00100000:2.0:1789181638.654822:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181638.654865:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510117632 00000100:00100000:2.0:1789181638.654873:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510117632 00000100:00100000:2.0:1789181638.654920:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789181638.654931:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0833d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876092510117632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181638.654990:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0833d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876092510117632:12345-0@lo:400:kworker.0 Request processed in 61us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181638.654997:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789181638.655021:0:15109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510117504 00000100:00100000:2.0:1789181638.655025:0:15109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510117504 00000100:00100000:2.0:1789181638.655061:0:15109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789181638.655067:0:15109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0833d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876092510117504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789181638.655096:0:15109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0833d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876092510117504:12345-0@lo:400:kworker.0 Request processed in 29us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181638.655101:0:15109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1789181638.655118:0:14419:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789181638.655147:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc0833d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876092510117504:0@lo:400:kworker.0 00000100:00100000:2.0:1789181638.655157:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc0833d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876092510117632:0@lo:400:kworker.0 00000100:00100000:0.0:1789181638.655653:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0833d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1876092510117760:0@lo:400:kworker.0 00000100:00100000:0.0:1789181638.655689:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181638.655710:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789181638.655718:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0833d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510117376:0@lo:400:kworker.0 00000100:00100000:0.0:1789181638.655737:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181638.655752:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0833d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1876092510117888:0@lo:400:kworker.0 00000100:00100000:0.0:1789181638.655771:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181638.655793:0:15740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510117760 00000100:00100000:0.0:1789181638.655798:0:15740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510117760 00000100:00100000:0.0:1789181638.655830:0:15740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510117888 00000100:00100000:0.0:1789181638.655833:0:15740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510117888 00000100:00100000:0.0:1789181638.655853:0:15740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789181638.655860:0:15740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c01c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876092510117760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181638.655892:0:15740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c01c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876092510117760:12345-0@lo:400:kworker.0 Request processed in 33us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181638.655906:0:15740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789181638.655919:0:15740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789181638.655925:0:15740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c01c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876092510117888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181638.655952:0:15740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c01c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876092510117888:12345-0@lo:400:kworker.0 Request processed in 28us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181638.655958:0:15740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789181638.655974:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510117376 00000100:00100000:0.0:1789181638.655977:0:15106:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510117376 00000100:00100000:0.0:1789181638.655996:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789181638.656001:0:15106:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c01c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510117376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789181638.656027:0:15106:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c01c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510117376:12345-0@lo:400:kworker.0 Request processed in 26us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181638.656032:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1789181638.656047:0:14419:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789181638.656065:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc0833d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510117376:0@lo:400:kworker.0 00000100:00100000:0.0:1789181638.656073:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc0833d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1876092510117888:0@lo:400:kworker.0 00000100:00100000:0.0:1789181638.656080:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc0833d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1876092510117760:0@lo:400:kworker.0 00000100:00100000:1.0:1789181638.656700:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0833d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876092510118016:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789181638.656735:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181638.658070:0:15110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510118016 00000100:00100000:2.0:1789181638.658080:0:15110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510118016 00000100:00100000:2.0:1789181638.658128:0:15110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789181638.658137:0:15110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c01b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876092510118016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789181638.658168:0:15110:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789181638.658231:0:15110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c01b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876092510118016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (1494us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181638.658252:0:15110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789181638.658371:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc0833d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876092510118016:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789181638.853054:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789181638.974567:0:14420:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789181638.974575:0:14420:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9dc1babd7800 from 10 10000000:01000000:0.0:1789181638.974829:0:14420:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789181638.974876:0:14420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc189890600/0x8f4f7840b2e4256d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181638.974888:0:14420:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.132@tcp lock: ffff9dc189890600/0x8f4f7840b2e4256d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181638.974928:0:14420:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.132@tcp lock: ffff9dc189890600/0x8f4f7840b2e4256d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181638.975019:0:14420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c0268380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:486954f1-c2e6-402a-b3c8-096af476560c:14420:1876092510118144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789181638.975090:0:14420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181638.975838:0:14420:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc189de5e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789181638.975975:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510118144 00000100:00100000:2.0:1789181638.975983:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510118144 00000100:00100000:2.0:1789181638.976027:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789181638.976048:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bbade050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:486954f1-c2e6-402a-b3c8-096af476560c+16:14420:x1876092510118144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789181638.976061:0:14416:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181638.976077:0:14416:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc1ba785400/0x8f4f7840b2e42574 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f4f7840b2e4256d expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181638.976101:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc1ba785400/0x8f4f7840b2e42574 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f4f7840b2e4256d expref: 17 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181638.976120:0:14416:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc1ba785400/0x8f4f7840b2e42574 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e4256d expref: 17 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181638.976128:0:14416:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1ba785400, rc 0) 00000100:00100000:2.0:1789181638.976185:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bbade050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:486954f1-c2e6-402a-b3c8-096af476560c+17:14420:x1876092510118144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (1095us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181638.976192:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789181638.976428:0:14420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c0268380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:486954f1-c2e6-402a-b3c8-096af476560c:14420:1876092510118144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789181638.976443:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.132@tcp lock: ffff9dc189890600/0x8f4f7840b2e4256d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e42574 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181638.976452:0:14420:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.132@tcp lock: ffff9dc189890600/0x8f4f7840b2e4256d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f4f7840b2e42574 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181638.976507:0:14420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c0268380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:486954f1-c2e6-402a-b3c8-096af476560c:14420:1876092510118272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789181638.976539:0:14420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789181638.976833:0:14420:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc189de5e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789181638.976954:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510118272 00000100:00100000:3.0:1789181638.976960:0:14418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510118272 00000100:00100000:3.0:1789181638.976993:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789181638.977001:0:14418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc081806c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:486954f1-c2e6-402a-b3c8-096af476560c+17:14420:x1876092510118272:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789181638.978650:0:14418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc081806c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:486954f1-c2e6-402a-b3c8-096af476560c+17:14420:x1876092510118272:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1646us (2105us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181638.978833:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789181638.978921:0:14420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c0268380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:486954f1-c2e6-402a-b3c8-096af476560c:14420:1876092510118272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789181638.978981:0:14420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0833d0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:486954f1-c2e6-402a-b3c8-096af476560c:14420:1876092510118400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789181638.979030:0:14420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181638.979082:0:14420:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1990069c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789181638.980106:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510118400 00000100:00100000:1.0:1789181638.980117:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510118400 00000100:00100000:1.0:1789181638.980171:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789181638.980181:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc081804450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:486954f1-c2e6-402a-b3c8-096af476560c+17:14420:x1876092510118400:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789181638.980430:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc081804450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:486954f1-c2e6-402a-b3c8-096af476560c+17:14420:x1876092510118400:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 239us (1389us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181638.980437:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789181638.983239:0:14420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc0833d0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:486954f1-c2e6-402a-b3c8-096af476560c:14420:1876092510118400:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789181638.985168:0:16589:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1789181638.986877:0:14420:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1789181638.986908:0:14420:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789181638.986919:0:14420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc189890600/0x8f4f7840b2e4256d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e42574 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181638.986932:0:14420:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.132@tcp lock: ffff9dc189890600/0x8f4f7840b2e4256d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e42574 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789181638.988802:0:14420:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789181638.988808:0:14420:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9dc1a68c7800 from 10 10000000:01000000:3.0:1789181638.988813:0:14420:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789181638.988856:0:14420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1e200/0x8f4f7840b2e4257b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181638.988868:0:14420:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1e200/0x8f4f7840b2e4257b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181638.988880:0:14420:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1e200/0x8f4f7840b2e4257b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181638.988923:0:14420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1988c0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:486954f1-c2e6-402a-b3c8-096af476560c:14420:1876092510118528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789181638.989529:0:14420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181638.989597:0:14420:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1ba5e0300 going to sleep for 11 seconds 00000100:00100000:2.0:1789181638.991500:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510118528 00000100:00100000:2.0:1789181638.991528:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510118528 00000100:00100000:2.0:1789181638.991592:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789181638.991603:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc081805c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:486954f1-c2e6-402a-b3c8-096af476560c+17:14420:x1876092510118528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789181638.991620:0:14417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181638.991638:0:14417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc1ba785600/0x8f4f7840b2e42582 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f4f7840b2e4257b expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181638.991678:0:14417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc1ba785600/0x8f4f7840b2e42582 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f4f7840b2e4257b expref: 18 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181638.991691:0:14417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc1ba785600/0x8f4f7840b2e42582 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e4257b expref: 18 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181638.991701:0:14417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1ba785600, rc 0) 00000100:00100000:2.0:1789181638.992051:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc081805c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:486954f1-c2e6-402a-b3c8-096af476560c+18:14420:x1876092510118528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 449us (2522us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181638.992057:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789181638.993359:0:14420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1988c0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:486954f1-c2e6-402a-b3c8-096af476560c:14420:1876092510118528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789181638.993394:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1e200/0x8f4f7840b2e4257b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e42582 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181638.993406:0:14420:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1e200/0x8f4f7840b2e4257b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f4f7840b2e42582 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181638.993494:0:14420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1988c0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:486954f1-c2e6-402a-b3c8-096af476560c:14420:1876092510118656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789181638.993539:0:14420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181638.993597:0:14420:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1ba5e0300 going to sleep for 11 seconds 00000100:00100000:2.0:1789181638.994777:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510118656 00000100:00100000:2.0:1789181638.994787:0:14418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510118656 00000100:00100000:2.0:1789181638.994832:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789181638.994841:0:14418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc081807850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:486954f1-c2e6-402a-b3c8-096af476560c+18:14420:x1876092510118656:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789181638.995142:0:14418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc081807850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:486954f1-c2e6-402a-b3c8-096af476560c+18:14420:x1876092510118656:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 301us (1601us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181638.995149:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789181638.998806:0:14420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1988c0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:486954f1-c2e6-402a-b3c8-096af476560c:14420:1876092510118656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789181638.998871:0:14420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1988c0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:486954f1-c2e6-402a-b3c8-096af476560c:14420:1876092510118784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789181638.998955:0:14420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181638.998992:0:14420:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1ba5e0300 going to sleep for 11 seconds 00000100:00100000:3.0:1789181638.999010:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510118784 00000100:00100000:3.0:1789181638.999016:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510118784 00000100:00100000:3.0:1789181638.999072:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789181638.999081:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc081804850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:486954f1-c2e6-402a-b3c8-096af476560c+18:14420:x1876092510118784:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789181638.999278:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc081804850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:486954f1-c2e6-402a-b3c8-096af476560c+18:14420:x1876092510118784:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 197us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181638.999286:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789181638.999361:0:14420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1988c0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:486954f1-c2e6-402a-b3c8-096af476560c:14420:1876092510118784:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789181639.000018:0:16590:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1789181639.000074:0:14420:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1789181639.000091:0:14420:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789181639.000101:0:14420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1e200/0x8f4f7840b2e4257b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e42582 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181639.000112:0:14420:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1e200/0x8f4f7840b2e4257b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e42582 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789181639.000122:0:14420:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789181639.000125:0:14420:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9dc1ba454000 from 10 10000000:01000000:3.0:1789181639.000128:0:14420:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789181639.000151:0:14420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1fc00/0x8f4f7840b2e42589 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181639.000159:0:14420:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1fc00/0x8f4f7840b2e42589 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181639.000169:0:14420:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1fc00/0x8f4f7840b2e42589 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181639.000184:0:14420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1988c0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:486954f1-c2e6-402a-b3c8-096af476560c:14420:1876092510118912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789181639.000215:0:14420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181639.000237:0:14420:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc189899780 going to sleep for 11 seconds 00000100:00100000:3.0:1789181639.000250:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510118912 00000100:00100000:3.0:1789181639.000254:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510118912 00000100:00100000:3.0:1789181639.000278:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789181639.000284:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc081805850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:486954f1-c2e6-402a-b3c8-096af476560c+18:14420:x1876092510118912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789181639.000301:0:14417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181639.000313:0:14417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc1bfa1ea00/0x8f4f7840b2e42590 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8f4f7840b2e42589 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181639.000352:0:14417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc1bfa1ea00/0x8f4f7840b2e42590 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8f4f7840b2e42589 expref: 19 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181639.000364:0:14417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc1bfa1ea00/0x8f4f7840b2e42590 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8f4f7840b2e42589 expref: 19 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181639.000373:0:14417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1bfa1ea00, rc 0) 00000100:00100000:3.0:1789181639.000417:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc081805850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:486954f1-c2e6-402a-b3c8-096af476560c+19:14420:x1876092510118912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181639.000423:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789181639.000458:0:14420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1988c0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:486954f1-c2e6-402a-b3c8-096af476560c:14420:1876092510118912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789181639.000470:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1fc00/0x8f4f7840b2e42589 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e42590 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181639.000479:0:14420:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1fc00/0x8f4f7840b2e42589 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8f4f7840b2e42590 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181639.000515:0:14420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1988c0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:486954f1-c2e6-402a-b3c8-096af476560c:14420:1876092510119040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789181639.000538:0:14420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181639.000556:0:14420:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc189899780 going to sleep for 11 seconds 00000100:00100000:3.0:1789181639.000567:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510119040 00000100:00100000:3.0:1789181639.000570:0:14418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510119040 00000100:00100000:3.0:1789181639.000591:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789181639.000597:0:14418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c1ce0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:486954f1-c2e6-402a-b3c8-096af476560c+19:14420:x1876092510119040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789181639.000798:0:14418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c1ce0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:486954f1-c2e6-402a-b3c8-096af476560c+19:14420:x1876092510119040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 200us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181639.000805:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789181639.000834:0:14420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1988c0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:486954f1-c2e6-402a-b3c8-096af476560c:14420:1876092510119040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789181639.000854:0:14420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1988c0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:486954f1-c2e6-402a-b3c8-096af476560c:14420:1876092510119168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789181639.000883:0:14420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181639.000896:0:14420:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1c03ced80 going to sleep for 11 seconds 00000100:00100000:3.0:1789181639.000906:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510119168 00000100:00100000:3.0:1789181639.000910:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510119168 00000100:00100000:3.0:1789181639.000928:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789181639.000933:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c1ce1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:486954f1-c2e6-402a-b3c8-096af476560c+19:14420:x1876092510119168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789181639.001042:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c1ce1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:486954f1-c2e6-402a-b3c8-096af476560c+19:14420:x1876092510119168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 108us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181639.001049:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789181639.001081:0:14420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1988c0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:486954f1-c2e6-402a-b3c8-096af476560c:14420:1876092510119168:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789181639.012974:0:16592:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1789181639.014368:0:14420:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1789181639.014407:0:14420:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789181639.014425:0:14420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1fc00/0x8f4f7840b2e42589 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e42590 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181639.014438:0:14420:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.132@tcp lock: ffff9dc1bfa1fc00/0x8f4f7840b2e42589 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8f4f7840b2e42590 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181639.190106:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181639.190155:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488104704 00000100:00100000:1.0:1789181639.190164:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488104704 00000100:00100000:1.0:1789181639.190213:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 115 00000100:00100000:1.0:1789181639.190223:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c1ce1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e09b034e-9c19-4cf8-a37d-2da41b05039c+11:13756:x1876092488104704:12345-192.168.204.32@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789181639.190241:0:14417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181639.190258:0:14417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc1baab9600/0x8f4f7840b2e42597 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f4af expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181639.190286:0:14417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc1baab9600/0x8f4f7840b2e42597 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f4af expref: 12 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181639.190311:0:14417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc1baab9600/0x8f4f7840b2e42597 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f4af expref: 12 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181639.190320:0:14417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1baab9600, rc 0) 00000100:00100000:1.0:1789181639.190413:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c1ce1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e09b034e-9c19-4cf8-a37d-2da41b05039c+12:13756:x1876092488104704:12345-192.168.204.32@tcp:101:ll_cfg_requeue.0 Request processed in 191us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181639.190430:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 115 00000100:00100000:2.0:1789181639.202120:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181639.208399:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488104832 00000100:00100000:0.0:1789181639.208412:0:14418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488104832 00000100:00100000:0.0:1789181639.209515:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 116 00000100:00100000:0.0:1789181639.209546:0:14418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c1ce0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e09b034e-9c19-4cf8-a37d-2da41b05039c+12:13756:x1876092488104832:12345-192.168.204.32@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789181639.209853:0:14418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c1ce0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e09b034e-9c19-4cf8-a37d-2da41b05039c+12:13756:x1876092488104832:12345-192.168.204.32@tcp:501:ll_cfg_requeue.0 Request processed in 311us (7742us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181639.209860:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 116 00000100:00100000:2.0:1789181639.220805:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181639.220869:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488104960 00000100:00100000:2.0:1789181639.220927:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488104960 00000100:00100000:1.0:1789181639.220977:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 117 00000100:00100000:1.0:1789181639.220990:0:14418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c1ce3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e09b034e-9c19-4cf8-a37d-2da41b05039c+12:13756:x1876092488104960:12345-192.168.204.32@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789181639.221320:0:14418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c1ce3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e09b034e-9c19-4cf8-a37d-2da41b05039c+12:13756:x1876092488104960:12345-192.168.204.32@tcp:503:ll_cfg_requeue.0 Request processed in 331us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181639.221327:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 117 00000100:00100000:1.0:1789181639.244008:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181639.244358:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488105088 00000100:00100000:0.0:1789181639.244368:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488105088 00000100:00100000:0.0:1789181639.244444:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 118 00000100:00100000:0.0:1789181639.244456:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c1ce1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e09b034e-9c19-4cf8-a37d-2da41b05039c+12:13756:x1876092488105088:12345-192.168.204.32@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789181639.244472:0:14417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181639.244489:0:14417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dc189890e00/0x8f4f7840b2e4259e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f4b6 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181639.244519:0:14417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dc189890e00/0x8f4f7840b2e4259e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f4b6 expref: 13 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181639.244530:0:14417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dc189890e00/0x8f4f7840b2e4259e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f4b6 expref: 13 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181639.244540:0:14417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc189890e00, rc 0) 00000100:00100000:0.0:1789181639.244600:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c1ce1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e09b034e-9c19-4cf8-a37d-2da41b05039c+13:13756:x1876092488105088:12345-192.168.204.32@tcp:101:ll_cfg_requeue.0 Request processed in 146us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181639.244607:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 118 00000100:00100000:2.0:1789181639.252855:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181639.258452:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488105216 00000100:00100000:1.0:1789181639.258469:0:14418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488105216 00000100:00100000:1.0:1789181639.258548:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 119 00000100:00100000:1.0:1789181639.258560:0:14418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c1ce3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e09b034e-9c19-4cf8-a37d-2da41b05039c+13:13756:x1876092488105216:12345-192.168.204.32@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789181639.258865:0:14418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c1ce3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e09b034e-9c19-4cf8-a37d-2da41b05039c+13:13756:x1876092488105216:12345-192.168.204.32@tcp:501:ll_cfg_requeue.0 Request processed in 306us (7542us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181639.258873:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 119 00000100:00100000:3.0:1789181639.265076:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181639.265148:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488105344 00000100:00100000:1.0:1789181639.265159:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488105344 00000100:00100000:1.0:1789181639.266543:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 120 00000100:00100000:1.0:1789181639.266558:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c1ce2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e09b034e-9c19-4cf8-a37d-2da41b05039c+13:13756:x1876092488105344:12345-192.168.204.32@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789181639.266814:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c1ce2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e09b034e-9c19-4cf8-a37d-2da41b05039c+13:13756:x1876092488105344:12345-192.168.204.32@tcp:503:ll_cfg_requeue.0 Request processed in 259us (1749us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181639.266824:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 120 00010000:00010000:3.0:1789181639.873020:0:16126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181640.793407:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181640.793436:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181640.793468:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181640.793499:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181640.793518:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181640.793533:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181640.793569:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181640.793590:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488105472 00000100:00100000:1.0:1789181640.793596:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488105984 00000100:00100000:1.0:1789181640.793600:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488105984 00000100:00100000:0.0:1789181640.793600:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488105472 00000100:00100000:1.0:1789181640.793637:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488105600 00000100:00100000:1.0:1789181640.793640:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488105600 00000100:00100000:0.0:1789181640.793641:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 121 00000100:00100000:0.0:1789181640.793650:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c1ce2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e09b034e-9c19-4cf8-a37d-2da41b05039c+13:2354:x1876092488105472:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:1.0:1789181640.793657:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 26 00000100:00100000:1.0:1789181640.793663:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c01b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f95d2205-e877-434a-82a2-5130e9e350fc+6:2354:x1876092488105984:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:3.0:1789181640.793743:0:15740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 27 00000100:00100000:3.0:1789181640.793752:0:15740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c01b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:049cbf1a-15b2-4d25-854c-0a3797b8f42e+6:2354:x1876092488105600:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:0.0:1789181640.793807:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c1ce2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e09b034e-9c19-4cf8-a37d-2da41b05039c+13:2354:x1876092488105472:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 157us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181640.793815:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 121 00000100:00100000:0.0:1789181640.793849:0:15109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488105728 00000100:00100000:0.0:1789181640.793852:0:15109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488105728 00000100:00100000:0.0:1789181640.793870:0:15109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488106240 00000100:00100000:0.0:1789181640.793873:0:15109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488106240 00000100:00100000:0.0:1789181640.793883:0:15109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488105856 00000100:00100000:0.0:1789181640.793885:0:15109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488105856 00000100:00100000:0.0:1789181640.793895:0:15109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488106112 00000100:00100000:0.0:1789181640.793897:0:15109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488106112 00000100:00100000:0.0:1789181640.793921:0:15109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 12 00000100:00100000:0.0:1789181640.793928:0:15109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c01b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:049cbf1a-15b2-4d25-854c-0a3797b8f42e+5:2354:x1876092488105728:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:2.0:1789181640.793992:0:15107:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1789181640.794002:0:15107:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1789181640.794112:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 13 00000100:00100000:2.0:1789181640.794120:0:15107:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c01b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f95d2205-e877-434a-82a2-5130e9e350fc+5:2354:x1876092488106240:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:1.0:1789181640.802004:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c01b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f95d2205-e877-434a-82a2-5130e9e350fc+6:2354:x1876092488105984:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 8327us (8521us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181640.802021:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 26 00000100:00080000:1.0:1789181640.802100:0:14419:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789181640.802106:0:14419:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789181640.802109:0:14419:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789181640.802420:0:16649:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1789181640.802428:0:16649:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:1.0:1789181640.802544:0:16649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 14 00000100:00100000:1.0:1789181640.802557:0:16649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c01b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:049cbf1a-15b2-4d25-854c-0a3797b8f42e+5:2354:x1876092488105856:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:1.0:1789181640.802610:0:16649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c01b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:049cbf1a-15b2-4d25-854c-0a3797b8f42e+5:2354:x1876092488105856:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 57us (9075us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181640.802623:0:16649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 14 00000100:00100000:1.0:1789181640.802636:0:16649:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1789181640.802644:0:16649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 15 00000100:00100000:1.0:1789181640.802651:0:16649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c01b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f95d2205-e877-434a-82a2-5130e9e350fc+5:2354:x1876092488106112:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:1.0:1789181640.802678:0:16649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c01b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f95d2205-e877-434a-82a2-5130e9e350fc+5:2354:x1876092488106112:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 28us (9108us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181640.802684:0:16649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 15 00000100:00100000:3.0:1789181640.811471:0:15740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c01b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:049cbf1a-15b2-4d25-854c-0a3797b8f42e+6:2354:x1876092488105600:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 17693us (17924us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181640.811487:0:15740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 27 00000100:00100000:0.0:1789181640.820104:0:15109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c01b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:049cbf1a-15b2-4d25-854c-0a3797b8f42e+5:2354:x1876092488105728:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 26163us (26653us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181640.820121:0:15109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 12 00000100:00100000:2.0:1789181640.826726:0:15107:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c01b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f95d2205-e877-434a-82a2-5130e9e350fc+5:2354:x1876092488106240:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 32591us (33211us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181640.826742:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 13 00010000:00010000:1.0:1789181640.897379:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181641.338775:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181641.338875:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488106368 00000100:00100000:0.0:1789181641.338888:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488106368 00000100:00100000:0.0:1789181641.338953:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 15 00000100:00100000:0.0:1789181641.338964:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c01b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:049cbf1a-15b2-4d25-854c-0a3797b8f42e+6:14413:x1876092488106368:12345-192.168.204.32@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789181641.338985:0:14424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181641.339007:0:14424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890c00/0x8f4f7840b2e425a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f4bd expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181641.339071:0:14424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891400/0x8f4f7840b2e425ac lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181641.339085:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891400/0x8f4f7840b2e425ac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181641.339109:0:14424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891400/0x8f4f7840b2e425ac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181641.339137:0:14424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e425b3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181641.339145:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e425b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181641.339152:0:14424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e425b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181641.339513:0:14424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890400/0x8f4f7840b2e425ba lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181641.339524:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890400/0x8f4f7840b2e425ba lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181641.339533:0:14424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890400/0x8f4f7840b2e425ba lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789181641.339557:0:14424:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789181641.339561:0:14424:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789181641.339595:0:14424:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890400/0x8f4f7840b2e425ba lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181641.339606:0:14424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891400/0x8f4f7840b2e425ac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181641.339613:0:14424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891400/0x8f4f7840b2e425ac lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181641.339630:0:14424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891400/0x8f4f7840b2e425ac lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181641.339637:0:14424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc189891400 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:0.0:1789181641.339641:0:14424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891400/0x8f4f7840b2e425ac lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181641.339649:0:14424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891400/0x8f4f7840b2e425ac lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181641.339660:0:14424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc18a6c2500) 00010000:00010000:0.0:1789181641.339664:0:14424:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789181641.339668:0:14424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891400/0x8f4f7840b2e425ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181641.339675:0:14424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891400/0x8f4f7840b2e425ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181641.339687:0:14424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e425b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181641.339694:0:14424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e425b3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181641.339700:0:14424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e425b3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181641.339705:0:14424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc189890000 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:0.0:1789181641.339708:0:14424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e425b3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181641.339722:0:14424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e425b3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181641.339730:0:14424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9dc18553a600) 00010000:00010000:0.0:1789181641.339733:0:14424:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789181641.339736:0:14424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e425b3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181641.339741:0:14424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e425b3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181641.339774:0:14424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890c00/0x8f4f7840b2e425a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f4bd expref: 8 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181641.339788:0:14424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890400/0x8f4f7840b2e425ba lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f4bd expref: 7 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181641.339795:0:14424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9dc18553a900) 00010000:00010000:0.0:1789181641.339798:0:14424:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789181641.339800:0:14424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc189890400, rc 0) 00000100:00100000:0.0:1789181641.339869:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c01b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:049cbf1a-15b2-4d25-854c-0a3797b8f42e+7:14413:x1876092488106368:12345-192.168.204.32@tcp:101:lhsmtool_posix.0 Request processed in 907us (1104us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181641.339877:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 15 00000100:00100000:1.0:1789181641.343065:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181641.343484:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488106624 00000100:00100000:0.0:1789181641.343496:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488106624 00000100:00100000:0.0:1789181641.343567:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 16 00000100:00100000:0.0:1789181641.343580:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c01b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:049cbf1a-15b2-4d25-854c-0a3797b8f42e+7:14413:x1876092488106624:12345-192.168.204.32@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789181641.343623:0:14423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181641.343661:0:14423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890a00/0x8f4f7840b2e425c1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f4c4 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181641.343762:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891600/0x8f4f7840b2e425c8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181641.343779:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891600/0x8f4f7840b2e425c8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181641.343793:0:14423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891600/0x8f4f7840b2e425c8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181641.343844:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891800/0x8f4f7840b2e425cf lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181641.343851:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891800/0x8f4f7840b2e425cf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181641.343859:0:14423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891800/0x8f4f7840b2e425cf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181641.347032:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891e00/0x8f4f7840b2e425d6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181641.347054:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891e00/0x8f4f7840b2e425d6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181641.347065:0:14423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891e00/0x8f4f7840b2e425d6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789181641.347078:0:14423:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1789181641.348364:0:14423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891600/0x8f4f7840b2e425c8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181641.348386:0:14423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891600/0x8f4f7840b2e425c8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181641.348394:0:14423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891600/0x8f4f7840b2e425c8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181641.348400:0:14423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc189891600 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:0.0:1789181641.348405:0:14423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891600/0x8f4f7840b2e425c8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181641.348412:0:14423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891600/0x8f4f7840b2e425c8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181641.348426:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9dc18553a900) 00010000:00010000:0.0:1789181641.348429:0:14423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789181641.348434:0:14423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891600/0x8f4f7840b2e425c8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181641.348440:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891600/0x8f4f7840b2e425c8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181641.348454:0:14423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891800/0x8f4f7840b2e425cf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181641.348459:0:14423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891800/0x8f4f7840b2e425cf lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181641.348464:0:14423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891800/0x8f4f7840b2e425cf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181641.348480:0:14423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc189891800 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:0.0:1789181641.348484:0:14423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891800/0x8f4f7840b2e425cf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181641.348489:0:14423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891800/0x8f4f7840b2e425cf lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181641.348497:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9dc18553ab00) 00010000:00010000:0.0:1789181641.348500:0:14423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789181641.348502:0:14423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891800/0x8f4f7840b2e425cf lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181641.348508:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891800/0x8f4f7840b2e425cf lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181641.354668:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890a00/0x8f4f7840b2e425c1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f4c4 expref: 10 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181641.354700:0:14423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891e00/0x8f4f7840b2e425d6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f4c4 expref: 9 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181641.354709:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9dc18553af00) 00010000:00010000:0.0:1789181641.354712:0:14423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789181641.354716:0:14423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc189891e00, rc 0) 00000100:00100000:0.0:1789181641.354794:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c01b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:049cbf1a-15b2-4d25-854c-0a3797b8f42e+9:14413:x1876092488106624:12345-192.168.204.32@tcp:101:lhsmtool_posix.0 Request processed in 11215us (11739us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1789181641.354803:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 16 00000100:00100000:3.0:1789181641.360638:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181641.361269:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488106752 00000100:00100000:0.0:1789181641.361293:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488106752 00000100:00100000:0.0:1789181641.361402:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 17 00000100:00100000:0.0:1789181641.361413:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1988c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:049cbf1a-15b2-4d25-854c-0a3797b8f42e+9:14413:x1876092488106752:12345-192.168.204.32@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1789181641.363137:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1988c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:049cbf1a-15b2-4d25-854c-0a3797b8f42e+9:14413:x1876092488106752:12345-192.168.204.32@tcp:59:lhsmtool_posix.0 Request processed in 1706us (2489us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181641.363149:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 17 00000100:00100000:1.0:1789181641.416801:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181641.416879:0:15740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488106880 00000100:00100000:3.0:1789181641.416901:0:15740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488106880 00000100:00100000:3.0:1789181641.416963:0:15740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 18 00000100:00100000:3.0:1789181641.416973:0:15740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6e5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:049cbf1a-15b2-4d25-854c-0a3797b8f42e+9:14419:x1876092488106880:12345-192.168.204.32@tcp:101:lfs.0 00010000:00010000:3.0:1789181641.416992:0:15740:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181641.417019:0:15740:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f200/0x8f4f7840b2e425e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f4cb expref: -99 pid: 15740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181641.417075:0:15740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e425eb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181641.417089:0:15740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e425eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181641.417101:0:15740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e425eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181641.417131:0:15740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e425f2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181641.417138:0:15740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e425f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181641.417144:0:15740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e425f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181641.417576:0:15740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e425eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181641.417584:0:15740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e425eb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181641.417592:0:15740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e425eb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181641.417604:0:15740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1bfa1f400 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:3.0:1789181641.417608:0:15740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e425eb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181641.417616:0:15740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e425eb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181641.417629:0:15740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc18a6c2500) 00010000:00010000:3.0:1789181641.417632:0:15740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181641.417638:0:15740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e425eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181641.417643:0:15740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e425eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181641.417656:0:15740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e425f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181641.417662:0:15740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e425f2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181641.417669:0:15740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e425f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181641.417673:0:15740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1bfa1fe00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:3.0:1789181641.417675:0:15740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e425f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181641.417681:0:15740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e425f2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181641.417697:0:15740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9dc192187f00) 00010000:00010000:3.0:1789181641.417699:0:15740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181641.417702:0:15740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e425f2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181641.417708:0:15740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e425f2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181641.417738:0:15740:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f200/0x8f4f7840b2e425e4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f4cb expref: 10 pid: 15740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181641.417748:0:15740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc18a6c2500) 00010000:00010000:3.0:1789181641.417750:0:15740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181641.417753:0:15740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f200/0x8f4f7840b2e425e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f4cb expref: 10 pid: 15740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181641.417763:0:15740:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1bfa1f200, rc 0) 00000100:00100000:3.0:1789181641.417830:0:15740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6e5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:049cbf1a-15b2-4d25-854c-0a3797b8f42e+9:14419:x1876092488106880:12345-192.168.204.32@tcp:101:lfs.0 Request processed in 859us (1038us total) trans 0 rc 301/301 00000100:00100000:3.0:1789181641.417837:0:15740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 18 00000100:00100000:3.0:1789181641.423518:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181641.423624:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488107008 00000100:00100000:1.0:1789181641.423634:0:14432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488107008 00000100:00100000:1.0:1789181641.423684:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 0 00000100:00100000:1.0:1789181641.423694:0:14432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1988c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:049cbf1a-15b2-4d25-854c-0a3797b8f42e+9:14419:x1876092488107008:12345-192.168.204.32@tcp:700:lfs.0 00000100:00100000:1.0:1789181641.423788:0:14432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1988c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:049cbf1a-15b2-4d25-854c-0a3797b8f42e+9:14419:x1876092488107008:12345-192.168.204.32@tcp:700:lfs.0 Request processed in 95us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181641.423795:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 0 00000100:00100000:1.0:1789181641.426628:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181641.426717:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488107264 00000100:00100000:2.0:1789181641.426725:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488107264 00000100:00100000:2.0:1789181641.426787:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 19 00000100:00100000:2.0:1789181641.426797:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:049cbf1a-15b2-4d25-854c-0a3797b8f42e+9:14419:x1876092488107264:12345-192.168.204.32@tcp:36:lfs.0 00010000:00010000:2.0:1789181641.426849:0:14425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789181641.426874:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784e00/0x8f4f7840b2e42527 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f446 expref: 9 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181641.426892:0:14425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc18a6c2500) 00010000:00010000:2.0:1789181641.426909:0:14425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789181641.427112:0:14425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784600/0x8f4f7840b2e425f9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181641.427126:0:14425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f800/0x8f4f7840b2e4255f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f4a8 expref: 5 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181641.427135:0:14425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784600/0x8f4f7840b2e425f9 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181641.427168:0:14425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f800/0x8f4f7840b2e4255f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f4a8 expref: 5 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181641.427187:0:14425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f800/0x8f4f7840b2e4255f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f4a8 expref: 5 pid: 14423 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181641.427202:0:14425:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc0833d0700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14425:1876092510119296:192.168.204.32@tcp:104: 00000100:00100000:2.0:1789181641.427396:0:14425:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc199eab9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789181641.430479:0:14425:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc0833d0700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14425:1876092510119296:192.168.204.32@tcp:104: 00010000:00010000:1.0:1789181641.430508:0:14425:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784600/0x8f4f7840b2e425f9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181641.432160:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181641.432492:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488107392 00000100:00100000:0.0:1789181641.432501:0:14410:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488107392 00010000:00010000:0.0:1789181641.432536:0:14410:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f800/0x8f4f7840b2e4255f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f4a8 expref: 6 pid: 14423 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181641.432567:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9 00000100:00100000:0.0:1789181641.432576:0:14410:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb7d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f95d2205-e877-434a-82a2-5130e9e350fc+6:2353:x1876092488107392:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789181641.432589:0:14410:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789181641.432596:0:14410:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f800/0x8f4f7840b2e4255f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f4a8 expref: 6 pid: 14423 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181641.432607:0:14410:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f800/0x8f4f7840b2e4255f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f4a8 expref: 6 pid: 14423 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181641.432628:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f800/0x8f4f7840b2e4255f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f4a8 expref: 6 pid: 14423 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181641.432644:0:14410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc18a6c2500) 00010000:00010000:0.0:1789181641.432649:0:14410:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784600/0x8f4f7840b2e425f9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181641.432674:0:14410:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784600/0x8f4f7840b2e425f9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181641.432682:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784600/0x8f4f7840b2e425f9 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181641.432710:0:14410:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789181641.432768:0:14410:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb7d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f95d2205-e877-434a-82a2-5130e9e350fc+5:2353:x1876092488107392:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 193us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181641.432775:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9 00010000:00010000:1.0:1789181641.433499:0:14425:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784600/0x8f4f7840b2e425f9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181641.433516:0:14425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784600/0x8f4f7840b2e425f9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181641.433545:0:14425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab8800/0x8f4f7840b2e42600 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181641.433557:0:14425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab8800/0x8f4f7840b2e42600 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181641.433566:0:14425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab8800/0x8f4f7840b2e42600 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789181641.436238:0:14425:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1789181641.436253:0:14425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784600/0x8f4f7840b2e425f9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181641.436365:0:14425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784600/0x8f4f7840b2e425f9 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181641.436380:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784600/0x8f4f7840b2e425f9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181641.436387:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1ba784600 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:1.0:1789181641.436392:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784600/0x8f4f7840b2e425f9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181641.436400:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784600/0x8f4f7840b2e425f9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181641.436415:0:14425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc18a6c2500) 00010000:00010000:1.0:1789181641.436418:0:14425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789181641.436431:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784600/0x8f4f7840b2e425f9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181641.436438:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784600/0x8f4f7840b2e425f9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789181641.436459:0:14425:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007fecf9b9 reply state 00000000ffd7eedb transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab8800/0x8f4f7840b2e42600 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181641.436469:0:14425:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789181641.436556:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:049cbf1a-15b2-4d25-854c-0a3797b8f42e+10:14419:x1876092488107264:12345-192.168.204.32@tcp:36:lfs.0 Request processed in 9757us (9934us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1789181641.436564:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 19 00010000:00010000:3.0:1789181641.441389:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab8800/0x8f4f7840b2e42600 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181641.441408:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab8800/0x8f4f7840b2e42600 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181641.441416:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab8800/0x8f4f7840b2e42600 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181641.441436:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1baab8800 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:3.0:1789181641.441441:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab8800/0x8f4f7840b2e42600 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181641.441450:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab8800/0x8f4f7840b2e42600 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181641.441467:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9dc19bc16e00) 00010000:00010000:3.0:1789181641.441470:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181641.441476:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab8800/0x8f4f7840b2e42600 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181641.441482:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab8800/0x8f4f7840b2e42600 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181641.529235:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181641.529623:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488107520 00000100:00100000:0.0:1789181641.529633:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488107520 00000100:00100000:0.0:1789181641.529690:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 20 00000100:00100000:0.0:1789181641.529700:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0833d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:049cbf1a-15b2-4d25-854c-0a3797b8f42e+9:14427:x1876092488107520:12345-192.168.204.32@tcp:101:lctl.0 00010000:00010000:0.0:1789181641.529723:0:14423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181641.529848:0:14423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890a00/0x8f4f7840b2e42607 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f4d2 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181641.529916:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891800/0x8f4f7840b2e4260e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181641.529931:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891800/0x8f4f7840b2e4260e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181641.529943:0:14423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891800/0x8f4f7840b2e4260e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789181641.529975:0:14423:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789181641.529978:0:14423:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789181641.530028:0:14423:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891800/0x8f4f7840b2e4260e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181641.530052:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890a00/0x8f4f7840b2e42607 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f4d2 expref: 11 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181641.530069:0:14423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891800/0x8f4f7840b2e4260e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f4d2 expref: 10 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181641.530079:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc18553ab00) 00010000:00010000:0.0:1789181641.530081:0:14423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789181641.530085:0:14423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc189891800, rc 0) 00000100:00100000:0.0:1789181641.530154:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0833d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:049cbf1a-15b2-4d25-854c-0a3797b8f42e+10:14427:x1876092488107520:12345-192.168.204.32@tcp:101:lctl.0 Request processed in 454us (927us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181641.530161:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 20 00000100:00100000:1.0:1789181641.557146:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181641.557361:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488107648 00000100:00100000:0.0:1789181641.557372:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488107648 00000100:00100000:0.0:1789181641.557527:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 21 00000100:00100000:0.0:1789181641.557539:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f95d2205-e877-434a-82a2-5130e9e350fc+5:14428:x1876092488107648:12345-192.168.204.32@tcp:101:lfs.0 00010000:00010000:0.0:1789181641.557558:0:14424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181641.557579:0:14424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890a00/0x8f4f7840b2e42615 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f4d9 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181641.557638:0:14424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891600/0x8f4f7840b2e4261c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181641.557652:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891600/0x8f4f7840b2e4261c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181641.557683:0:14424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891600/0x8f4f7840b2e4261c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789181641.557718:0:14424:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789181641.557722:0:14424:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789181641.557815:0:14424:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891600/0x8f4f7840b2e4261c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181641.557842:0:14424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890a00/0x8f4f7840b2e42615 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f4d9 expref: 7 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181641.557861:0:14424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891600/0x8f4f7840b2e4261c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f4d9 expref: 6 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181641.557870:0:14424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc18553ab00) 00010000:00010000:0.0:1789181641.557873:0:14424:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789181641.557877:0:14424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc189891600, rc 0) 00000100:00100000:0.0:1789181641.557936:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f95d2205-e877-434a-82a2-5130e9e350fc+6:14428:x1876092488107648:12345-192.168.204.32@tcp:101:lfs.0 Request processed in 400us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181641.557944:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 21 00000100:00100000:2.0:1789181641.563249:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181641.563695:0:15740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488107776 00000100:00100000:3.0:1789181641.563705:0:15740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488107776 00000100:00100000:3.0:1789181641.563856:0:15740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 22 00000100:00100000:3.0:1789181641.563867:0:15740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0833d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f95d2205-e877-434a-82a2-5130e9e350fc+6:14428:x1876092488107776:12345-192.168.204.32@tcp:101:lfs.0 00010000:00010000:3.0:1789181641.563886:0:15740:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181641.563915:0:15740:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f200/0x8f4f7840b2e42623 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f4e0 expref: -99 pid: 15740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181641.563975:0:15740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e4262a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181641.563988:0:15740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e4262a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181641.564013:0:15740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e4262a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181641.564028:0:15740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e42631 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181641.564035:0:15740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e42631 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181641.564042:0:15740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e42631 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181641.564395:0:15740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e42638 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181641.564404:0:15740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e42638 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181641.564503:0:15740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e42638 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789181641.564535:0:15740:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789181641.564539:0:15740:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789181641.564556:0:15740:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e42638 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181641.564568:0:15740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e4262a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181641.564576:0:15740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e4262a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181641.564592:0:15740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e4262a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181641.564599:0:15740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1bfa1fe00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:3.0:1789181641.564604:0:15740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e4262a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181641.564612:0:15740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e4262a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181641.564624:0:15740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc18553ab00) 00010000:00010000:3.0:1789181641.564627:0:15740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181641.564632:0:15740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e4262a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181641.564638:0:15740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e4262a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181641.564652:0:15740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e42631 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181641.564659:0:15740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e42631 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181641.564665:0:15740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e42631 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181641.564670:0:15740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1bfa1f400 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:3.0:1789181641.564672:0:15740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e42631 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181641.564686:0:15740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e42631 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181641.564693:0:15740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9dc192187f00) 00010000:00010000:3.0:1789181641.564696:0:15740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181641.564699:0:15740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e42631 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181641.564704:0:15740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e42631 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181641.564731:0:15740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f200/0x8f4f7840b2e42623 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f4e0 expref: 8 pid: 15740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181641.564812:0:15740:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e42638 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f4e0 expref: 7 pid: 15740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181641.564818:0:15740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9dc192187100) 00010000:00010000:3.0:1789181641.564821:0:15740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789181641.564823:0:15740:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1bfa1ee00, rc 0) 00000100:00100000:3.0:1789181641.564925:0:15740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0833d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f95d2205-e877-434a-82a2-5130e9e350fc+7:14428:x1876092488107776:12345-192.168.204.32@tcp:101:lfs.0 Request processed in 1060us (1687us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181641.564934:0:15740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 22 00000100:00100000:2.0:1789181641.568227:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181641.568364:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488108032 00000100:00100000:1.0:1789181641.568380:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488108032 00000100:00100000:1.0:1789181641.568434:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 23 00000100:00100000:1.0:1789181641.568443:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0833d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f95d2205-e877-434a-82a2-5130e9e350fc+7:14428:x1876092488108032:12345-192.168.204.32@tcp:101:lfs.0 00010000:00010000:1.0:1789181641.568462:0:14424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181641.568481:0:14424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab9400/0x8f4f7840b2e4263f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f4e7 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789181641.568564:0:14424:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1789181641.568675:0:14424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab9400/0x8f4f7840b2e4263f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f4e7 expref: 9 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181641.568689:0:14424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc18553ab00) 00010000:00010000:1.0:1789181641.568692:0:14424:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789181641.568697:0:14424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab9400/0x8f4f7840b2e4263f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f4e7 expref: 9 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181641.568727:0:14424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1baab9400, rc 0) 00000100:00100000:1.0:1789181641.569048:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0833d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f95d2205-e877-434a-82a2-5130e9e350fc+8:14428:x1876092488108032:12345-192.168.204.32@tcp:101:lfs.0 Request processed in 606us (828us total) trans 8589934595 rc 301/301 00000100:00100000:1.0:1789181641.569056:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 23 00000100:00100000:1.0:1789181641.576046:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181641.576280:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488108288 00000100:00100000:0.0:1789181641.576289:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488108288 00000100:00100000:0.0:1789181641.576385:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 24 00000100:00100000:0.0:1789181641.576396:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f95d2205-e877-434a-82a2-5130e9e350fc+8:14428:x1876092488108288:12345-192.168.204.32@tcp:36:lfs.0 00010000:00010000:1.0:1789181641.576722:0:14423:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789181641.576757:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e42638 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f4e0 expref: 8 pid: 15740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181641.576777:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9dc192187100) 00010000:00010000:1.0:1789181641.576789:0:14423:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789181641.576811:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab8200/0x8f4f7840b2e4264d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181641.576823:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab8200/0x8f4f7840b2e4264d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181641.576833:0:14423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab8200/0x8f4f7840b2e4264d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789181641.577040:0:14423:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bb02b658 reply state 00000000b4925f8e transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab8200/0x8f4f7840b2e4264d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181641.577049:0:14423:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789181641.577056:0:14423:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1789181641.577256:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f95d2205-e877-434a-82a2-5130e9e350fc+9:14428:x1876092488108288:12345-192.168.204.32@tcp:36:lfs.0 Request processed in 861us (1217us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1789181641.577263:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 24 00010000:00010000:1.0:1789181641.579274:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab8200/0x8f4f7840b2e4264d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181641.579289:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab8200/0x8f4f7840b2e4264d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181641.579296:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab8200/0x8f4f7840b2e4264d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181641.579303:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1baab8200 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:1.0:1789181641.579307:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab8200/0x8f4f7840b2e4264d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181641.579314:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab8200/0x8f4f7840b2e4264d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181641.579380:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9dc19bc16700) 00010000:00010000:1.0:1789181641.579384:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1789181641.579389:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab8200/0x8f4f7840b2e4264d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181641.579396:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab8200/0x8f4f7840b2e4264d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181641.581873:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181641.582303:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488108544 00000100:00100000:2.0:1789181641.582314:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488108544 00000100:00100000:2.0:1789181641.582409:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2 00000100:00100000:2.0:1789181641.582430:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f95d2205-e877-434a-82a2-5130e9e350fc+8:14428:x1876092488108544:12345-192.168.204.32@tcp:35:lfs.0 00000100:00100000:2.0:1789181641.582652:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f95d2205-e877-434a-82a2-5130e9e350fc+9:14428:x1876092488108544:12345-192.168.204.32@tcp:35:lfs.0 Request processed in 225us (786us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1789181641.582658:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2 00000100:00100000:2.0:1789181641.585384:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181641.585829:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488108800 00000100:00100000:3.0:1789181641.585838:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488108800 00000100:00100000:2.0:1789181641.586055:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 25 00000100:00100000:2.0:1789181641.586065:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0833d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f95d2205-e877-434a-82a2-5130e9e350fc+9:14428:x1876092488108800:12345-192.168.204.32@tcp:101:lfs.0 00010000:00010000:2.0:1789181641.586086:0:14425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181641.586115:0:14425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784600/0x8f4f7840b2e42654 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f4ee expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181641.586183:0:14425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785a00/0x8f4f7840b2e4265b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181641.586212:0:14425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785a00/0x8f4f7840b2e4265b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181641.586224:0:14425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785a00/0x8f4f7840b2e4265b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181641.586238:0:14425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785000/0x8f4f7840b2e42662 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181641.586245:0:14425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785000/0x8f4f7840b2e42662 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181641.586251:0:14425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785000/0x8f4f7840b2e42662 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789181641.586386:0:14425:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789181641.586673:0:14425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785a00/0x8f4f7840b2e4265b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181641.586682:0:14425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785a00/0x8f4f7840b2e4265b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181641.586687:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785a00/0x8f4f7840b2e4265b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181641.586694:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1ba785a00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:2.0:1789181641.586698:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785a00/0x8f4f7840b2e4265b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181641.586705:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785a00/0x8f4f7840b2e4265b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181641.586726:0:14425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc18553ab00) 00010000:00010000:2.0:1789181641.586729:0:14425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789181641.586743:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785a00/0x8f4f7840b2e4265b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181641.586751:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785a00/0x8f4f7840b2e4265b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181641.586763:0:14425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785000/0x8f4f7840b2e42662 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181641.586769:0:14425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785000/0x8f4f7840b2e42662 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181641.586775:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785000/0x8f4f7840b2e42662 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181641.586780:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1ba785000 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:2.0:1789181641.586783:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785000/0x8f4f7840b2e42662 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181641.586790:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785000/0x8f4f7840b2e42662 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181641.586797:0:14425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9dc18a6c2b00) 00010000:00010000:2.0:1789181641.586799:0:14425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789181641.586802:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785000/0x8f4f7840b2e42662 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181641.586808:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785000/0x8f4f7840b2e42662 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181641.586851:0:14425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784600/0x8f4f7840b2e42654 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f4ee expref: 11 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181641.586861:0:14425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc18553ab00) 00010000:00010000:2.0:1789181641.586863:0:14425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789181641.586867:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784600/0x8f4f7840b2e42654 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f4ee expref: 11 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181641.586876:0:14425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1ba784600, rc 0) 00000100:00100000:2.0:1789181641.586942:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0833d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f95d2205-e877-434a-82a2-5130e9e350fc+10:14428:x1876092488108800:12345-192.168.204.32@tcp:101:lfs.0 Request processed in 879us (1566us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1789181641.586950:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 25 00000100:00100000:3.0:1789181641.589201:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181641.589981:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488108928 00000100:00100000:1.0:1789181641.589993:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488108928 00000100:00100000:1.0:1789181641.590059:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 26 00000100:00100000:1.0:1789181641.590069:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1988c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f95d2205-e877-434a-82a2-5130e9e350fc+10:14428:x1876092488108928:12345-192.168.204.32@tcp:101:lfs.0 00010000:00010000:1.0:1789181641.590091:0:14424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181641.590124:0:14424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab9400/0x8f4f7840b2e42670 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f4f5 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181641.590220:0:14424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab9800/0x8f4f7840b2e42677 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181641.590234:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab9800/0x8f4f7840b2e42677 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181641.590246:0:14424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab9800/0x8f4f7840b2e42677 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789181641.590270:0:14424:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789181641.590274:0:14424:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789181641.590290:0:14424:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab9800/0x8f4f7840b2e42677 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181641.590315:0:14424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab9400/0x8f4f7840b2e42670 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f4f5 expref: 12 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181641.590367:0:14424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab9800/0x8f4f7840b2e42677 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f4f5 expref: 11 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181641.590540:0:14424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9dc19bc16200) 00010000:00010000:1.0:1789181641.590544:0:14424:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789181641.590548:0:14424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1baab9800, rc 0) 00000100:00100000:1.0:1789181641.590609:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1988c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f95d2205-e877-434a-82a2-5130e9e350fc+11:14428:x1876092488108928:12345-192.168.204.32@tcp:101:lfs.0 Request processed in 541us (1416us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181641.590616:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 26 00000100:00100000:1.0:1789181641.593957:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181641.594027:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488109056 00000100:00100000:2.0:1789181641.594037:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488109056 00000100:00100000:2.0:1789181641.594116:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 3 00000100:00100000:2.0:1789181641.594126:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f95d2205-e877-434a-82a2-5130e9e350fc+11:14428:x1876092488109056:12345-192.168.204.32@tcp:37:lfs.0 00000100:00100000:1.0:1789181641.598988:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f95d2205-e877-434a-82a2-5130e9e350fc+11:14428:x1876092488109056:12345-192.168.204.32@tcp:37:lfs.0 Request processed in 4852us (5082us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181641.599013:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 3 00000100:00100000:3.0:1789181641.602073:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181641.602301:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488109312 00000100:00100000:1.0:1789181641.602310:0:14427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488109312 00000100:00100000:1.0:1789181641.602584:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 4 00000100:00100000:1.0:1789181641.602595:0:14427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1ba445c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f95d2205-e877-434a-82a2-5130e9e350fc+11:14428:x1876092488109312:12345-192.168.204.32@tcp:35:lfs.0 00000100:00100000:1.0:1789181641.602870:0:14427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1ba445c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f95d2205-e877-434a-82a2-5130e9e350fc+12:14428:x1876092488109312:12345-192.168.204.32@tcp:35:lfs.0 Request processed in 276us (804us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1789181641.602878:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 4 00000100:00100000:2.0:1789181641.659902:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181641.659982:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488109440 00000100:00100000:1.0:1789181641.659992:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488109440 00000100:00100000:1.0:1789181641.660057:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 27 00000100:00100000:1.0:1789181641.660070:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc0833d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:049cbf1a-15b2-4d25-854c-0a3797b8f42e+10:14434:x1876092488109440:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:1.0:1789181641.660095:0:14424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181641.660128:0:14424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab9400/0x8f4f7840b2e4267e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f4fc expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181641.660205:0:14424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab8200/0x8f4f7840b2e42685 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181641.660223:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab8200/0x8f4f7840b2e42685 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181641.660236:0:14424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab8200/0x8f4f7840b2e42685 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181641.660252:0:14424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab8000/0x8f4f7840b2e4268c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181641.660279:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab8000/0x8f4f7840b2e4268c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181641.660286:0:14424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab8000/0x8f4f7840b2e4268c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181641.660432:0:14424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab9200/0x8f4f7840b2e42693 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181641.660440:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab9200/0x8f4f7840b2e42693 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181641.660447:0:14424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab9200/0x8f4f7840b2e42693 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789181641.660472:0:14424:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789181641.660475:0:14424:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789181641.660510:0:14424:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab9200/0x8f4f7840b2e42693 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181641.660521:0:14424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab8200/0x8f4f7840b2e42685 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181641.660529:0:14424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab8200/0x8f4f7840b2e42685 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181641.660536:0:14424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab8200/0x8f4f7840b2e42685 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181641.660541:0:14424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1baab8200 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:1.0:1789181641.660546:0:14424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab8200/0x8f4f7840b2e42685 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181641.660558:0:14424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab8200/0x8f4f7840b2e42685 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181641.660570:0:14424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc18553ab00) 00010000:00010000:1.0:1789181641.660573:0:14424:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789181641.660578:0:14424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab8200/0x8f4f7840b2e42685 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181641.660585:0:14424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab8200/0x8f4f7840b2e42685 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181641.660596:0:14424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab8000/0x8f4f7840b2e4268c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181641.660602:0:14424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab8000/0x8f4f7840b2e4268c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181641.660609:0:14424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab8000/0x8f4f7840b2e4268c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181641.660613:0:14424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1baab8000 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:1.0:1789181641.660616:0:14424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab8000/0x8f4f7840b2e4268c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181641.660622:0:14424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab8000/0x8f4f7840b2e4268c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181641.660628:0:14424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9dc19bc16700) 00010000:00010000:1.0:1789181641.660630:0:14424:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789181641.660633:0:14424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab8000/0x8f4f7840b2e4268c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181641.660647:0:14424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab8000/0x8f4f7840b2e4268c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181641.660674:0:14424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab9400/0x8f4f7840b2e4267e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f4fc expref: 12 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181641.660687:0:14424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab9200/0x8f4f7840b2e42693 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f4fc expref: 11 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181641.660695:0:14424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9dc19bc16200) 00010000:00010000:1.0:1789181641.660697:0:14424:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789181641.660699:0:14424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1baab9200, rc 0) 00000100:00100000:1.0:1789181641.661032:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc0833d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:049cbf1a-15b2-4d25-854c-0a3797b8f42e+11:14434:x1876092488109440:12345-192.168.204.32@tcp:101:bash.0 Request processed in 964us (1149us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181641.661040:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 27 00000100:00100000:0.0:1789181641.668591:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181641.668717:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488109696 00000100:00100000:2.0:1789181641.668726:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488109696 00000100:00100000:2.0:1789181641.668793:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 28 00000100:00100000:2.0:1789181641.668804:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c026a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:049cbf1a-15b2-4d25-854c-0a3797b8f42e+11:14434:x1876092488109696:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:2.0:1789181641.668823:0:14423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789181641.668844:0:14423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784600/0x8f4f7840b2e4269a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f503 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181641.669092:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785000/0x8f4f7840b2e426a1 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181641.669127:0:14423:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab9800/0x8f4f7840b2e42677 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f4f5 expref: 11 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181641.669135:0:14423:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785000/0x8f4f7840b2e426a1 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181641.669168:0:14423:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab9800/0x8f4f7840b2e42677 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f4f5 expref: 11 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181641.669180:0:14423:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab9800/0x8f4f7840b2e42677 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f4f5 expref: 11 pid: 14424 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181641.669194:0:14423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc19c36c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14423:1876092510119424:192.168.204.32@tcp:104: 00000100:00100000:2.0:1789181641.669313:0:14423:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc199eab3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789181641.672391:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181641.672526:0:14423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc19c36c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14423:1876092510119424:192.168.204.32@tcp:104: 00010000:00010000:1.0:1789181641.672550:0:14423:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785000/0x8f4f7840b2e426a1 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181641.673053:0:16538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488109824 00000100:00100000:1.0:1789181641.673060:0:16538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488109824 00010000:00010000:1.0:1789181641.673092:0:16538:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab9800/0x8f4f7840b2e42677 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f4f5 expref: 12 pid: 14424 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181641.673179:0:16538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 10 00000100:00100000:1.0:1789181641.673189:0:16538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1988c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f95d2205-e877-434a-82a2-5130e9e350fc+12:2354:x1876092488109824:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789181641.673216:0:16538:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789181641.673223:0:16538:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab9800/0x8f4f7840b2e42677 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f4f5 expref: 12 pid: 14424 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181641.673236:0:16538:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab9800/0x8f4f7840b2e42677 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f4f5 expref: 12 pid: 14424 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181641.673257:0:16538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab9800/0x8f4f7840b2e42677 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f4f5 expref: 12 pid: 14424 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181641.673273:0:16538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9dc19bc16200) 00010000:00010000:1.0:1789181641.673278:0:16538:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785000/0x8f4f7840b2e426a1 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181641.673288:0:16538:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785000/0x8f4f7840b2e426a1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181641.673297:0:16538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785000/0x8f4f7840b2e426a1 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181641.673326:0:16538:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789181641.673560:0:16538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1988c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f95d2205-e877-434a-82a2-5130e9e350fc+11:2354:x1876092488109824:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 371us (1178us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181641.673567:0:16538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 10 00010000:00010000:3.0:1789181641.673619:0:14423:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785000/0x8f4f7840b2e426a1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181641.673627:0:14423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785000/0x8f4f7840b2e426a1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181641.673650:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f200/0x8f4f7840b2e426a8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181641.673659:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f200/0x8f4f7840b2e426a8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181641.673666:0:14423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f200/0x8f4f7840b2e426a8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181641.674971:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e426af lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181641.674986:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e426af lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181641.674995:0:14423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e426af lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789181641.675005:0:14423:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789181641.675034:0:14423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785000/0x8f4f7840b2e426a1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181641.675042:0:14423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785000/0x8f4f7840b2e426a1 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181641.675048:0:14423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785000/0x8f4f7840b2e426a1 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181641.675067:0:14423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1ba785000 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:3.0:1789181641.675071:0:14423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785000/0x8f4f7840b2e426a1 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181641.675079:0:14423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785000/0x8f4f7840b2e426a1 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181641.675091:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9dc19bc16200) 00010000:00010000:3.0:1789181641.675094:0:14423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181641.675099:0:14423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785000/0x8f4f7840b2e426a1 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181641.675791:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785000/0x8f4f7840b2e426a1 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789181641.675813:0:14423:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000032407782 reply state 00000000a3ee0712 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f200/0x8f4f7840b2e426a8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181641.675822:0:14423:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789181641.675863:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784600/0x8f4f7840b2e4269a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f503 expref: 14 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181641.675876:0:14423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e426af lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f503 expref: 13 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181641.675885:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dc192187c00) 00010000:00010000:3.0:1789181641.675887:0:14423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1789181641.675900:0:14423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1bfa1f400, rc 0) 00000100:00100000:3.0:1789181641.676168:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c026a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:049cbf1a-15b2-4d25-854c-0a3797b8f42e+14:14434:x1876092488109696:12345-192.168.204.32@tcp:101:bash.0 Request processed in 7364us (7584us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1789181641.676183:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 28 00010000:00010000:3.0:1789181641.684936:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f200/0x8f4f7840b2e426a8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181641.684955:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f200/0x8f4f7840b2e426a8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181641.684963:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f200/0x8f4f7840b2e426a8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181641.684970:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1bfa1f200 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:3.0:1789181641.684976:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f200/0x8f4f7840b2e426a8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181641.684984:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f200/0x8f4f7840b2e426a8 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181641.685000:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9dc192187f00) 00010000:00010000:3.0:1789181641.685003:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789181641.685008:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f200/0x8f4f7840b2e426a8 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181641.685015:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f200/0x8f4f7840b2e426a8 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181641.695004:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181641.695132:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488109952 00000100:00100000:1.0:1789181641.695143:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488109952 00000100:00100000:1.0:1789181641.695197:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 29 00000100:00100000:1.0:1789181641.695207:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c36fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:049cbf1a-15b2-4d25-854c-0a3797b8f42e+13:14434:x1876092488109952:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:1.0:1789181641.695245:0:14424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181641.695266:0:14424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab9400/0x8f4f7840b2e426bd lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f50a expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181641.695325:0:14424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab8000/0x8f4f7840b2e426c4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181641.695378:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab8000/0x8f4f7840b2e426c4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181641.695391:0:14424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab8000/0x8f4f7840b2e426c4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789181641.695523:0:14424:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1789181641.695528:0:14424:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789181641.695546:0:14424:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab8000/0x8f4f7840b2e426c4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181641.695556:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab8000/0x8f4f7840b2e426c4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181641.695578:0:14424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab9400/0x8f4f7840b2e426bd lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f50a expref: 15 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181641.695595:0:14424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab8000/0x8f4f7840b2e426c4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f50a expref: 14 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181641.695603:0:14424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dc192187c00) 00010000:00010000:1.0:1789181641.695606:0:14424:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789181641.695609:0:14424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1baab8000, rc 0) 00000100:00100000:1.0:1789181641.695659:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c36fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:049cbf1a-15b2-4d25-854c-0a3797b8f42e+14:14434:x1876092488109952:12345-192.168.204.32@tcp:101:bash.0 Request processed in 453us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181641.695666:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 29 00000100:00100000:2.0:1789181641.699641:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181641.699879:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488110208 00000100:00100000:1.0:1789181641.699889:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488110208 00000100:00100000:1.0:1789181641.700020:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 5 00000100:00100000:1.0:1789181641.700030:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c36c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:049cbf1a-15b2-4d25-854c-0a3797b8f42e+14:14434:x1876092488110208:12345-192.168.204.32@tcp:35:bash.0 00000100:00100000:1.0:1789181641.700393:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c36c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:049cbf1a-15b2-4d25-854c-0a3797b8f42e+15:14434:x1876092488110208:12345-192.168.204.32@tcp:35:bash.0 Request processed in 364us (761us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1789181641.700401:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 5 00000100:00100000:0.0:1789181641.819821:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181641.820847:0:15740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488110464 00000100:00100000:3.0:1789181641.820859:0:15740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488110464 00000100:00100000:3.0:1789181641.820928:0:15740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 30 00000100:00100000:3.0:1789181641.820940:0:15740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c026b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:049cbf1a-15b2-4d25-854c-0a3797b8f42e+15:14444:x1876092488110464:12345-192.168.204.32@tcp:101:lfs.0 00010000:00010000:3.0:1789181641.820966:0:15740:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181641.820998:0:15740:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f200/0x8f4f7840b2e426cb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f511 expref: -99 pid: 15740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789181641.821097:0:15740:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1789181641.821213:0:15740:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f200/0x8f4f7840b2e426cb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f511 expref: 17 pid: 15740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181641.821227:0:15740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc18553ab00) 00010000:00010000:3.0:1789181641.821230:0:15740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789181641.821236:0:15740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f200/0x8f4f7840b2e426cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f511 expref: 17 pid: 15740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181641.821251:0:15740:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1bfa1f200, rc 0) 00000100:00100000:3.0:1789181641.822041:0:15740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c026b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:049cbf1a-15b2-4d25-854c-0a3797b8f42e+16:14444:x1876092488110464:12345-192.168.204.32@tcp:101:lfs.0 Request processed in 1101us (2225us total) trans 8589934602 rc 301/301 00000100:00100000:3.0:1789181641.822049:0:15740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 30 00000100:00100000:2.0:1789181641.828763:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181641.834676:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488110720 00000100:00100000:3.0:1789181641.834693:0:14427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488110720 00000100:00100000:3.0:1789181641.834768:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 6 00000100:00100000:3.0:1789181641.834788:0:14427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c36df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:049cbf1a-15b2-4d25-854c-0a3797b8f42e+16:14444:x1876092488110720:12345-192.168.204.32@tcp:35:lfs.0 00000100:00100000:3.0:1789181641.835207:0:14427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c36df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:049cbf1a-15b2-4d25-854c-0a3797b8f42e+17:14444:x1876092488110720:12345-192.168.204.32@tcp:35:lfs.0 Request processed in 430us (6453us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1789181641.835215:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 6 00010000:00010000:3.0:1789181641.918726:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789181641.937281:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181641.937503:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488110976 00000100:00100000:1.0:1789181641.937513:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488110976 00000100:00100000:1.0:1789181641.937670:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 31 00000100:00100000:1.0:1789181641.937682:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c36f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:049cbf1a-15b2-4d25-854c-0a3797b8f42e+17:14447:x1876092488110976:12345-192.168.204.32@tcp:101:lfs.0 00010000:00010000:1.0:1789181641.937706:0:14424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181641.937738:0:14424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab9400/0x8f4f7840b2e426d9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f518 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181641.937833:0:14424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab9800/0x8f4f7840b2e426e0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181641.937848:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab9800/0x8f4f7840b2e426e0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181641.937860:0:14424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab9800/0x8f4f7840b2e426e0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789181641.937872:0:14424:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789181641.938006:0:14424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab9400/0x8f4f7840b2e426d9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f518 expref: 20 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181641.938025:0:14424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab9800/0x8f4f7840b2e426e0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f518 expref: 19 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181641.938034:0:14424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dc192187c00) 00010000:00010000:1.0:1789181641.938037:0:14424:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789181641.938041:0:14424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1baab9800, rc 0) 00000100:00100000:1.0:1789181641.938104:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c36f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:049cbf1a-15b2-4d25-854c-0a3797b8f42e+19:14447:x1876092488110976:12345-192.168.204.32@tcp:101:lfs.0 Request processed in 424us (833us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1789181641.938112:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 31 00000100:00100000:0.0:1789181641.940969:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181641.941232:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488111104 00000100:00100000:3.0:1789181641.941242:0:14410:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488111104 00000100:00100000:3.0:1789181641.941303:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 0 00000100:00100000:3.0:1789181641.941315:0:14410:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c026ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:049cbf1a-15b2-4d25-854c-0a3797b8f42e+19:2353:x1876092488111104:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789181641.941369:0:14410:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789181641.941396:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab9800/0x8f4f7840b2e426e0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f518 expref: 19 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181641.941413:0:14410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dc192187c00) 00010000:00010000:3.0:1789181641.941418:0:14410:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789181641.941738:0:14410:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c026ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:049cbf1a-15b2-4d25-854c-0a3797b8f42e+18:2353:x1876092488111104:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 425us (777us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181641.941746:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 0 00000100:00100000:2.0:1789181641.941794:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181641.941847:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488111232 00000100:00100000:1.0:1789181641.941852:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488111232 00000100:00100000:1.0:1789181641.941920:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 32 00000100:00100000:1.0:1789181641.941928:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c36f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:049cbf1a-15b2-4d25-854c-0a3797b8f42e+18:14447:x1876092488111232:12345-192.168.204.32@tcp:54:lfs.0 00010000:00010000:1.0:1789181641.941979:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab8200/0x8f4f7840b2e426ee lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181641.941992:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab8200/0x8f4f7840b2e426ee lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181641.942003:0:14423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab8200/0x8f4f7840b2e426ee lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181641.942027:0:14423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab8200/0x8f4f7840b2e426ee lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181641.942034:0:14423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab8200/0x8f4f7840b2e426ee lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181641.942050:0:14423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab8200/0x8f4f7840b2e426ee lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181641.942056:0:14423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1baab8200 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:1.0:1789181641.942060:0:14423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab8200/0x8f4f7840b2e426ee lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181641.942068:0:14423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab8200/0x8f4f7840b2e426ee lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181641.942078:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dc192187c00) 00010000:00010000:1.0:1789181641.942081:0:14423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789181641.942084:0:14423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab8200/0x8f4f7840b2e426ee lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181641.942090:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab8200/0x8f4f7840b2e426ee lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181641.942157:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c36f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:049cbf1a-15b2-4d25-854c-0a3797b8f42e+18:14447:x1876092488111232:12345-192.168.204.32@tcp:54:lfs.0 Request processed in 230us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181641.942164:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 32 00000100:00100000:2.0:1789181641.944500:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181641.944592:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488111488 00000100:00100000:3.0:1789181641.944600:0:14427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488111488 00000100:00100000:3.0:1789181641.944679:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 7 00000100:00100000:3.0:1789181641.944689:0:14427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c36c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:049cbf1a-15b2-4d25-854c-0a3797b8f42e+18:14447:x1876092488111488:12345-192.168.204.32@tcp:35:lfs.0 00000100:00100000:3.0:1789181641.944941:0:14427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c36c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:049cbf1a-15b2-4d25-854c-0a3797b8f42e+19:14447:x1876092488111488:12345-192.168.204.32@tcp:35:lfs.0 Request processed in 252us (445us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1789181641.944949:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 7 00000040:00080000:3.0:1789181642.239786:0:14458:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789181642.293382:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181642.293602:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488111744 00000100:00100000:1.0:1789181642.293612:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488111744 00000100:00080000:0.0:1789181642.293680:0:14419:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789181642.293696:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 33 00000100:00100000:1.0:1789181642.293717:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1baba6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:049cbf1a-15b2-4d25-854c-0a3797b8f42e+19:14478:x1876092488111744:12345-192.168.204.32@tcp:101:cat.0 00010000:00010000:1.0:1789181642.293739:0:14425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181642.293759:0:14425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab8200/0x8f4f7840b2e426f5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f51f expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181642.294020:0:14425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab9400/0x8f4f7840b2e426fc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181642.294035:0:14425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab9400/0x8f4f7840b2e426fc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181642.294047:0:14425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab9400/0x8f4f7840b2e426fc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789181642.294059:0:14425:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789181642.294197:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab8200/0x8f4f7840b2e426f5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f51f expref: 22 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181642.294215:0:14425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab9400/0x8f4f7840b2e426fc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f51f expref: 21 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181642.294543:0:14425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dc192187c00) 00010000:00010000:1.0:1789181642.294547:0:14425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789181642.294552:0:14425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1baab9400, rc 0) 00000100:00100000:1.0:1789181642.294613:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1baba6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:049cbf1a-15b2-4d25-854c-0a3797b8f42e+21:14478:x1876092488111744:12345-192.168.204.32@tcp:101:cat.0 Request processed in 908us (1290us total) trans 8589934606 rc 0/0 00000100:00100000:1.0:1789181642.294621:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 33 00000100:00100000:3.0:1789181642.299615:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181642.299787:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181642.300350:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488111872 00000100:00100000:2.0:1789181642.300514:0:14408:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488111872 00000100:00100000:2.0:1789181642.300647:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1 00000100:00100000:2.0:1789181642.300659:0:14408:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1988c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:049cbf1a-15b2-4d25-854c-0a3797b8f42e+21:2353:x1876092488111872:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789181642.300677:0:14408:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789181642.300718:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab9400/0x8f4f7840b2e426fc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f51f expref: 21 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181642.300735:0:14408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dc192187c00) 00010000:00010000:2.0:1789181642.300740:0:14408:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789181642.300937:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488112128 00000100:00100000:1.0:1789181642.300943:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488112128 00000100:00100000:2.0:1789181642.300989:0:14408:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1988c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:049cbf1a-15b2-4d25-854c-0a3797b8f42e+21:2353:x1876092488111872:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 332us (1383us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181642.300998:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1 00000100:00100000:1.0:1789181642.301036:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 8 00000100:00100000:1.0:1789181642.301046:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1988c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:049cbf1a-15b2-4d25-854c-0a3797b8f42e+20:14478:x1876092488112128:12345-192.168.204.32@tcp:35:cat.0 00000100:00100000:1.0:1789181642.301586:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1988c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:049cbf1a-15b2-4d25-854c-0a3797b8f42e+21:14478:x1876092488112128:12345-192.168.204.32@tcp:35:cat.0 Request processed in 542us (1798us total) trans 8589934607 rc 0/0 00000100:00100000:1.0:1789181642.301602:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 8 00000100:00100000:0.0:1789181642.415048:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181642.415190:0:15740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488112384 00000100:00100000:3.0:1789181642.415211:0:15740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488112384 00000100:00100000:3.0:1789181642.415282:0:15740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 34 00000100:00100000:3.0:1789181642.415294:0:15740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c0269c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:049cbf1a-15b2-4d25-854c-0a3797b8f42e+21:14484:x1876092488112384:12345-192.168.204.32@tcp:101:dd.0 00010000:00010000:3.0:1789181642.415359:0:15740:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181642.415381:0:15740:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f200/0x8f4f7840b2e4270a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f526 expref: -99 pid: 15740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181642.415937:0:15740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e42711 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181642.415953:0:15740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e42711 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181642.415965:0:15740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e42711 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789181642.415977:0:15740:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789181642.416121:0:15740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f200/0x8f4f7840b2e4270a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f526 expref: 24 pid: 15740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181642.416140:0:15740:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e42711 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f526 expref: 23 pid: 15740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181642.416149:0:15740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dc192187c00) 00010000:00010000:3.0:1789181642.416153:0:15740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789181642.416157:0:15740:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1bfa1fe00, rc 0) 00000100:00100000:3.0:1789181642.417257:0:15740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c0269c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:049cbf1a-15b2-4d25-854c-0a3797b8f42e+23:14484:x1876092488112384:12345-192.168.204.32@tcp:101:dd.0 Request processed in 1961us (3446us total) trans 8589934608 rc 0/0 00000100:00100000:3.0:1789181642.417274:0:15740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 34 00000100:00100000:3.0:1789181642.421736:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181642.422230:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488112512 00000100:00100000:1.0:1789181642.422252:0:14409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488112512 00000100:00100000:1.0:1789181642.422317:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 2 00000100:00100000:1.0:1789181642.422376:0:14409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6e3e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:049cbf1a-15b2-4d25-854c-0a3797b8f42e+23:2353:x1876092488112512:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789181642.422392:0:14409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789181642.422428:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e42711 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f526 expref: 23 pid: 15740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181642.422450:0:14409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dc192187c00) 00010000:00010000:1.0:1789181642.422631:0:14409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789181642.422699:0:14409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6e3e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:049cbf1a-15b2-4d25-854c-0a3797b8f42e+22:2353:x1876092488112512:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 325us (973us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181642.422708:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 2 00000100:00100000:2.0:1789181642.426795:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181642.427152:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488112768 00000100:00100000:1.0:1789181642.427162:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488112768 00000100:00100000:1.0:1789181642.427229:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 35 00000100:00100000:1.0:1789181642.427240:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1baba4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:049cbf1a-15b2-4d25-854c-0a3797b8f42e+22:14484:x1876092488112768:12345-192.168.204.32@tcp:36:dd.0 00010000:00010000:1.0:1789181642.427297:0:14424:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789181642.427587:0:14424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab8000/0x8f4f7840b2e426c4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f50a expref: 22 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181642.427606:0:14424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dc192187c00) 00010000:00010000:1.0:1789181642.427611:0:14424:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789181642.430512:0:14424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab8200/0x8f4f7840b2e4271f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181642.430552:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab8200/0x8f4f7840b2e4271f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181642.430564:0:14424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab8200/0x8f4f7840b2e4271f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789181642.430658:0:14424:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:1.0:1789181642.430689:0:14424:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000c6812c8 reply state 0000000084ac8c96 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab8200/0x8f4f7840b2e4271f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181642.430698:0:14424:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789181642.432131:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1baba4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:049cbf1a-15b2-4d25-854c-0a3797b8f42e+24:14484:x1876092488112768:12345-192.168.204.32@tcp:36:dd.0 Request processed in 3575us (4026us total) trans 8589934610 rc 0/0 00000100:00100000:1.0:1789181642.432142:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 35 00000020:00080000:1.0:1789181642.432148:0:14424:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789181642.436658:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab8200/0x8f4f7840b2e4271f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181642.436676:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab8200/0x8f4f7840b2e4271f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181642.436685:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab8200/0x8f4f7840b2e4271f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181642.436692:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1baab8200 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:1.0:1789181642.436697:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab8200/0x8f4f7840b2e4271f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181642.436705:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab8200/0x8f4f7840b2e4271f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181642.436750:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dc192187c00) 00010000:00010000:1.0:1789181642.436753:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789181642.436758:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab8200/0x8f4f7840b2e4271f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181642.436765:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab8200/0x8f4f7840b2e4271f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181642.512251:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181642.512428:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488113024 00000100:00100000:3.0:1789181642.512438:0:14427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488113024 00000100:00100000:3.0:1789181642.512500:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 9 00000100:00100000:3.0:1789181642.512511:0:14427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1baba4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:049cbf1a-15b2-4d25-854c-0a3797b8f42e+23:14484:x1876092488113024:12345-192.168.204.32@tcp:35:dd.0 00000100:00100000:3.0:1789181642.512810:0:14427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1baba4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:049cbf1a-15b2-4d25-854c-0a3797b8f42e+24:14484:x1876092488113024:12345-192.168.204.32@tcp:35:dd.0 Request processed in 301us (570us total) trans 8589934611 rc 0/0 00000100:00100000:3.0:1789181642.512819:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 9 00000100:00100000:3.0:1789181642.718416:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181642.719143:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488113152 00000100:00100000:0.0:1789181642.719153:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488113152 00000100:00100000:0.0:1789181642.719217:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 36 00000100:00100000:0.0:1789181642.719229:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1988c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:049cbf1a-15b2-4d25-854c-0a3797b8f42e+24:14498:x1876092488113152:12345-192.168.204.32@tcp:101:stat.0 00010000:00010000:0.0:1789181642.719253:0:14423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181642.719273:0:14423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890c00/0x8f4f7840b2e42726 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f52d expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181642.719384:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890a00/0x8f4f7840b2e4272d lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181642.719399:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890a00/0x8f4f7840b2e4272d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181642.719410:0:14423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890a00/0x8f4f7840b2e4272d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181642.719426:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e42734 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181642.719434:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e42734 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181642.719441:0:14423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e42734 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181642.719537:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891400/0x8f4f7840b2e4273b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181642.719545:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891400/0x8f4f7840b2e4273b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181642.719567:0:14423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891400/0x8f4f7840b2e4273b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789181642.719604:0:14423:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1789181642.719609:0:14423:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789181642.719816:0:14423:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891400/0x8f4f7840b2e4273b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181642.719830:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891400/0x8f4f7840b2e4273b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181642.719838:0:14423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890a00/0x8f4f7840b2e4272d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181642.719845:0:14423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890a00/0x8f4f7840b2e4272d lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181642.719851:0:14423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890a00/0x8f4f7840b2e4272d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181642.719857:0:14423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc189890a00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:0.0:1789181642.719861:0:14423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890a00/0x8f4f7840b2e4272d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181642.719869:0:14423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890a00/0x8f4f7840b2e4272d lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181642.719880:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9dc19bc16200) 00010000:00010000:0.0:1789181642.719883:0:14423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789181642.719887:0:14423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890a00/0x8f4f7840b2e4272d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181642.719904:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890a00/0x8f4f7840b2e4272d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181642.719919:0:14423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e42734 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181642.719925:0:14423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e42734 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181642.719931:0:14423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e42734 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181642.719936:0:14423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc189890000 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:0.0:1789181642.719939:0:14423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e42734 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181642.719945:0:14423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e42734 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181642.719952:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9dc18553a600) 00010000:00010000:0.0:1789181642.719954:0:14423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789181642.719957:0:14423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e42734 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181642.719961:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e42734 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181642.719992:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890c00/0x8f4f7840b2e42726 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f52d expref: 26 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181642.720014:0:14423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891400/0x8f4f7840b2e4273b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f52d expref: 25 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181642.720021:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dc192187c00) 00010000:00010000:0.0:1789181642.720023:0:14423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789181642.720025:0:14423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc189891400, rc 0) 00000100:00100000:0.0:1789181642.720086:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1988c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:049cbf1a-15b2-4d25-854c-0a3797b8f42e+25:14498:x1876092488113152:12345-192.168.204.32@tcp:101:stat.0 Request processed in 860us (1681us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181642.720094:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 36 00000100:00100000:0.0:1789181642.751539:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1baba6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876092510119552:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789181642.751604:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181642.752846:0:15110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510119552 00000100:00100000:2.0:1789181642.752857:0:15110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510119552 00000100:00100000:2.0:1789181642.752928:0:15110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789181642.752938:0:15110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c0269f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876092510119552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789181642.752971:0:15110:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789181642.753028:0:15110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c0269f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876092510119552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (1423us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181642.753035:0:15110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789181642.753097:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1baba6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876092510119552:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789181642.758896:0:14419:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789181642.812969:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181642.824184:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488113408 00000100:00100000:3.0:1789181642.824198:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488113408 00000100:00100000:3.0:1789181642.824257:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 37 00000100:00100000:3.0:1789181642.824267:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:049cbf1a-15b2-4d25-854c-0a3797b8f42e+25:14504:x1876092488113408:12345-192.168.204.32@tcp:36:truncate.0 00010000:00010000:3.0:1789181642.824328:0:14425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789181642.824377:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891400/0x8f4f7840b2e4273b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f52d expref: 25 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181642.824407:0:14425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dc192187c00) 00010000:00010000:3.0:1789181642.824412:0:14425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789181642.825018:0:14425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f200/0x8f4f7840b2e42742 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181642.825034:0:14425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f200/0x8f4f7840b2e42742 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181642.825045:0:14425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f200/0x8f4f7840b2e42742 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789181642.825092:0:14425:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934612 00000004:00010000:3.0:1789181642.825120:0:14425:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a7687528 reply state 0000000040a1d226 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f200/0x8f4f7840b2e42742 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181642.825129:0:14425:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789181642.825259:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:049cbf1a-15b2-4d25-854c-0a3797b8f42e+27:14504:x1876092488113408:12345-192.168.204.32@tcp:36:truncate.0 Request processed in 992us (12298us total) trans 8589934613 rc 0/0 00000100:00100000:3.0:1789181642.825267:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 37 00000020:00080000:3.0:1789181642.825272:0:14425:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789181642.831436:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f200/0x8f4f7840b2e42742 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181642.831454:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f200/0x8f4f7840b2e42742 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181642.831471:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f200/0x8f4f7840b2e42742 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181642.831478:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1bfa1f200 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:0.0:1789181642.831483:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f200/0x8f4f7840b2e42742 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181642.831491:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f200/0x8f4f7840b2e42742 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181642.831526:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dc192187c00) 00010000:00010000:0.0:1789181642.831528:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789181642.831534:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f200/0x8f4f7840b2e42742 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181642.831540:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f200/0x8f4f7840b2e42742 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789181642.862683:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934593 is committed 00000001:00080000:2.0:1789181642.866279:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934610 is committed 00000001:00080000:2.0:1789181642.866306:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000001:00080000:2.0:1789181642.866358:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934611 is committed 00010000:00010000:3.0:1789181642.942546:0:16126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181642.998523:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181642.998614:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488113536 00000100:00100000:0.0:1789181642.998625:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488113536 00000100:00100000:0.0:1789181642.998688:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 38 00000100:00100000:0.0:1789181642.998697:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:049cbf1a-15b2-4d25-854c-0a3797b8f42e+12:14518:x1876092488113536:12345-192.168.204.32@tcp:101:stat.0 00010000:00010000:0.0:1789181642.998720:0:14423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181642.998740:0:14423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e42749 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f534 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181642.999393:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890a00/0x8f4f7840b2e42750 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181642.999409:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890a00/0x8f4f7840b2e42750 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181642.999422:0:14423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890a00/0x8f4f7840b2e42750 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181642.999436:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890800/0x8f4f7840b2e42757 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181642.999443:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890800/0x8f4f7840b2e42757 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181642.999468:0:14423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890800/0x8f4f7840b2e42757 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181642.999748:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891400/0x8f4f7840b2e4275e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181642.999885:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891400/0x8f4f7840b2e4275e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181642.999894:0:14423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891400/0x8f4f7840b2e4275e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789181642.999929:0:14423:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:0.0:1789181642.999933:0:14423:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789181642.999950:0:14423:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891400/0x8f4f7840b2e4275e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181642.999962:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891400/0x8f4f7840b2e4275e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181642.999970:0:14423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890a00/0x8f4f7840b2e42750 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181642.999977:0:14423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890a00/0x8f4f7840b2e42750 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181642.999984:0:14423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890a00/0x8f4f7840b2e42750 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181642.999991:0:14423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc189890a00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:0.0:1789181642.999995:0:14423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890a00/0x8f4f7840b2e42750 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181643.000009:0:14423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890a00/0x8f4f7840b2e42750 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181643.000021:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9dc19bc16200) 00010000:00010000:0.0:1789181643.000024:0:14423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789181643.000029:0:14423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890a00/0x8f4f7840b2e42750 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181643.000034:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890a00/0x8f4f7840b2e42750 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181643.000044:0:14423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890800/0x8f4f7840b2e42757 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181643.000049:0:14423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890800/0x8f4f7840b2e42757 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181643.000055:0:14423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890800/0x8f4f7840b2e42757 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181643.000059:0:14423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc189890800 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:0.0:1789181643.000061:0:14423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890800/0x8f4f7840b2e42757 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181643.000067:0:14423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890800/0x8f4f7840b2e42757 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181643.000074:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9dc18553a600) 00010000:00010000:0.0:1789181643.000076:0:14423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789181643.000080:0:14423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890800/0x8f4f7840b2e42757 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181643.000096:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890800/0x8f4f7840b2e42757 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181643.000287:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e42749 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f534 expref: 14 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181643.000302:0:14423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891400/0x8f4f7840b2e4275e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f534 expref: 13 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181643.000321:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dc192187c00) 00010000:00010000:0.0:1789181643.000323:0:14423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789181643.000326:0:14423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc189891400, rc 0) 00000100:00100000:0.0:1789181643.000520:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:049cbf1a-15b2-4d25-854c-0a3797b8f42e+13:14518:x1876092488113536:12345-192.168.204.32@tcp:101:stat.0 Request processed in 1823us (2008us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181643.000529:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 38 00000100:00100000:2.0:1789181643.106446:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181643.106597:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488113792 00000100:00100000:3.0:1789181643.106608:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488113792 00000100:00100000:3.0:1789181643.106664:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 39 00000100:00100000:3.0:1789181643.106675:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1baba6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:049cbf1a-15b2-4d25-854c-0a3797b8f42e+13:14528:x1876092488113792:12345-192.168.204.32@tcp:101:lfs.0 00010000:00010000:3.0:1789181643.106694:0:14425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181643.106713:0:14425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e42765 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f53b expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789181643.106832:0:14425:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1789181643.107148:0:14425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e42765 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f53b expref: 15 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181643.107164:0:14425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc18553ab00) 00010000:00010000:3.0:1789181643.107168:0:14425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789181643.107173:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e42765 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f53b expref: 15 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181643.107189:0:14425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1bfa1ee00, rc 0) 00000100:00100000:3.0:1789181643.107250:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1baba6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:049cbf1a-15b2-4d25-854c-0a3797b8f42e+14:14528:x1876092488113792:12345-192.168.204.32@tcp:101:lfs.0 Request processed in 577us (813us total) trans 8589934614 rc 301/301 00000100:00100000:3.0:1789181643.107257:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 39 00000100:00100000:1.0:1789181643.112640:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181643.112865:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488114048 00000100:00100000:3.0:1789181643.112884:0:14427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488114048 00000100:00100000:3.0:1789181643.113067:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 10 00000100:00100000:3.0:1789181643.113081:0:14427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1ba444450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:049cbf1a-15b2-4d25-854c-0a3797b8f42e+14:14528:x1876092488114048:12345-192.168.204.32@tcp:35:lfs.0 00000100:00100000:3.0:1789181643.113318:0:14427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1ba444450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:049cbf1a-15b2-4d25-854c-0a3797b8f42e+15:14528:x1876092488114048:12345-192.168.204.32@tcp:35:lfs.0 Request processed in 240us (686us total) trans 8589934615 rc 0/0 00000100:00100000:3.0:1789181643.113326:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 10 00000100:00100000:1.0:1789181643.206770:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181643.207056:0:15740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488114304 00000100:00100000:3.0:1789181643.207065:0:15740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488114304 00000100:00100000:3.0:1789181643.207126:0:15740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 40 00000100:00100000:3.0:1789181643.207137:0:15740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:049cbf1a-15b2-4d25-854c-0a3797b8f42e+15:14534:x1876092488114304:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:3.0:1789181643.207161:0:15740:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181643.207182:0:15740:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e42773 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f542 expref: -99 pid: 15740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181643.207280:0:15740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f800/0x8f4f7840b2e4277a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181643.207296:0:15740:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e426af lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f503 expref: 16 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181643.207316:0:15740:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891400/0x8f4f7840b2e4275e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f534 expref: 16 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181643.207324:0:15740:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f800/0x8f4f7840b2e4277a lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181643.207397:0:15740:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891400/0x8f4f7840b2e4275e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f534 expref: 16 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181643.207441:0:15740:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891400/0x8f4f7840b2e4275e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f534 expref: 16 pid: 14423 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181643.207455:0:15740:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1988c3100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15740:1876092510119680:192.168.204.32@tcp:104: 00010000:00010000:3.0:1789181643.207555:0:15740:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e426af lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f503 expref: 16 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181643.207564:0:15740:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e426af lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f503 expref: 16 pid: 14423 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181643.207572:0:15740:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1988c0380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15740:1876092510119808:192.168.204.32@tcp:104: 00000100:00100000:3.0:1789181643.207594:0:15740:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc18799e180 going to sleep for 11 seconds 00000100:00100000:0.0:1789181643.215170:0:15740:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1988c3100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15740:1876092510119680:192.168.204.32@tcp:104: 00000100:00100000:0.0:1789181643.215187:0:15740:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1988c0380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15740:1876092510119808:192.168.204.32@tcp:104: 00010000:00010000:0.0:1789181643.215215:0:15740:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f800/0x8f4f7840b2e4277a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181643.220540:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181643.220628:0:16538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488114432 00000100:00100000:0.0:1789181643.220638:0:16538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488114432 00010000:00010000:0.0:1789181643.220679:0:16538:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891400/0x8f4f7840b2e4275e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f534 expref: 17 pid: 14423 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181643.220720:0:16538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 11 00000100:00100000:0.0:1789181643.220745:0:16538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:049cbf1a-15b2-4d25-854c-0a3797b8f42e+17:2354:x1876092488114432:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789181643.220760:0:16538:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789181643.220767:0:16538:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891400/0x8f4f7840b2e4275e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f534 expref: 17 pid: 14423 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181643.220791:0:16538:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891400/0x8f4f7840b2e4275e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f534 expref: 17 pid: 14423 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181643.220812:0:16538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891400/0x8f4f7840b2e4275e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f534 expref: 17 pid: 14423 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181643.220828:0:16538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dc192187c00) 00010000:00010000:0.0:1789181643.220833:0:16538:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f800/0x8f4f7840b2e4277a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181643.220842:0:16538:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f800/0x8f4f7840b2e4277a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181643.220848:0:16538:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789181643.221038:0:16538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:049cbf1a-15b2-4d25-854c-0a3797b8f42e+16:2354:x1876092488114432:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 294us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181643.221047:0:16538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 11 00000100:00100000:2.0:1789181643.231442:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181643.231888:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488114560 00000100:00100000:1.0:1789181643.231899:0:14409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488114560 00010000:00010000:1.0:1789181643.231939:0:14409:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e426af lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f503 expref: 16 pid: 14423 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181643.232080:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 12 00000100:00100000:1.0:1789181643.232091:0:14409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1baba6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:049cbf1a-15b2-4d25-854c-0a3797b8f42e+16:2353:x1876092488114560:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789181643.232211:0:14409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789181643.232221:0:14409:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e426af lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f503 expref: 16 pid: 14423 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181643.232235:0:14409:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e426af lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f503 expref: 16 pid: 14423 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181643.232257:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e426af lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f503 expref: 16 pid: 14423 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181643.232286:0:14409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dc192187c00) 00010000:00010000:1.0:1789181643.232292:0:14409:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f800/0x8f4f7840b2e4277a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181643.232301:0:14409:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f800/0x8f4f7840b2e4277a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181643.232319:0:14409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f800/0x8f4f7840b2e4277a lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181643.232983:0:14409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789181643.233059:0:14409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1baba6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:049cbf1a-15b2-4d25-854c-0a3797b8f42e+15:2353:x1876092488114560:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 967us (1623us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181643.233068:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 12 00010000:00010000:3.0:1789181643.233270:0:15740:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f800/0x8f4f7840b2e4277a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181643.233279:0:15740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f800/0x8f4f7840b2e4277a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789181643.233298:0:15740:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:3.0:1789181643.233493:0:15740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e42773 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f542 expref: 16 pid: 15740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181643.233510:0:15740:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f800/0x8f4f7840b2e4277a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f542 expref: 15 pid: 15740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181643.233518:0:15740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dc192187c00) 00010000:00010000:3.0:1789181643.233529:0:15740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789181643.233533:0:15740:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1bfa1f800, rc 0) 00000100:00100000:3.0:1789181643.233559:0:15740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:049cbf1a-15b2-4d25-854c-0a3797b8f42e+15:14534:x1876092488114304:12345-192.168.204.32@tcp:101:bash.0 Request processed in 26426us (26800us total) trans 8589934616 rc 0/0 00000100:00100000:3.0:1789181643.233566:0:15740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 40 00000100:00100000:1.0:1789181643.238584:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181643.238663:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488114816 00000100:00100000:2.0:1789181643.238673:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488114816 00000100:00100000:2.0:1789181643.238739:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 41 00000100:00100000:2.0:1789181643.238748:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:049cbf1a-15b2-4d25-854c-0a3797b8f42e+15:14534:x1876092488114816:12345-192.168.204.32@tcp:36:bash.0 00010000:00010000:2.0:1789181643.244534:0:14424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784600/0x8f4f7840b2e42788 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181643.244559:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784600/0x8f4f7840b2e42788 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181643.244571:0:14424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784600/0x8f4f7840b2e42788 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789181643.244672:0:14424:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000004:00010000:2.0:1789181643.244719:0:14424:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e09b32b9 reply state 00000000b5993897 transno 8589934618 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784600/0x8f4f7840b2e42788 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181643.244728:0:14424:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789181643.246671:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:049cbf1a-15b2-4d25-854c-0a3797b8f42e+18:14534:x1876092488114816:12345-192.168.204.32@tcp:36:bash.0 Request processed in 7353us (7524us total) trans 8589934618 rc 0/0 00000100:00100000:2.0:1789181643.246683:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 41 00000020:00080000:2.0:1789181643.247676:0:14424:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789181643.251879:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181643.252261:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488114944 00000100:00100000:0.0:1789181643.252271:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488114944 00000100:00100000:0.0:1789181643.252364:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 42 00000100:00100000:0.0:1789181643.252375:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1baba7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:049cbf1a-15b2-4d25-854c-0a3797b8f42e+18:14534:x1876092488114944:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:0.0:1789181643.252400:0:14423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181643.252431:0:14423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e4278f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f549 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181643.252504:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e4278f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f549 expref: 19 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181643.252517:0:14423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e4278f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f549 expref: 19 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181643.252533:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dc192187c00) 00010000:00010000:0.0:1789181643.252535:0:14423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789181643.252539:0:14423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc189890000, rc 0) 00000100:00100000:0.0:1789181643.252599:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1baba7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:049cbf1a-15b2-4d25-854c-0a3797b8f42e+19:14534:x1876092488114944:12345-192.168.204.32@tcp:101:bash.0 Request processed in 226us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181643.252606:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 42 00010000:00010000:1.0:1789181643.254066:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784600/0x8f4f7840b2e42788 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181643.254081:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784600/0x8f4f7840b2e42788 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181643.254088:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784600/0x8f4f7840b2e42788 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181643.254094:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1ba784600 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:1.0:1789181643.254098:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784600/0x8f4f7840b2e42788 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181643.254115:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784600/0x8f4f7840b2e42788 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181643.254151:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dc192187c00) 00010000:00010000:1.0:1789181643.254154:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789181643.254159:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784600/0x8f4f7840b2e42788 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181643.254166:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba784600/0x8f4f7840b2e42788 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181643.262455:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181643.262592:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488115072 00000100:00100000:3.0:1789181643.262601:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488115072 00000100:00100000:3.0:1789181643.262648:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 43 00000100:00100000:3.0:1789181643.262657:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:049cbf1a-15b2-4d25-854c-0a3797b8f42e+18:14534:x1876092488115072:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:3.0:1789181643.262676:0:14425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181643.262693:0:14425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e42796 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f550 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181643.262766:0:14425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e4279d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181643.262779:0:14425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f800/0x8f4f7840b2e4277a lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f542 expref: 19 pid: 15740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181643.262786:0:14425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e4279d lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181643.262815:0:14425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f800/0x8f4f7840b2e4277a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f542 expref: 19 pid: 15740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181643.262826:0:14425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f800/0x8f4f7840b2e4277a lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f542 expref: 19 pid: 15740 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181643.262850:0:14425:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1988c0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14425:1876092510119936:192.168.204.32@tcp:104: 00000100:00100000:3.0:1789181643.262947:0:14425:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1989bc9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789181643.266479:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181643.266650:0:16538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488115200 00000100:00100000:0.0:1789181643.266660:0:16538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488115200 00010000:00010000:0.0:1789181643.266698:0:16538:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f800/0x8f4f7840b2e4277a lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f542 expref: 20 pid: 15740 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181643.266738:0:16538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 13 00000100:00100000:0.0:1789181643.266747:0:16538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1baba5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:049cbf1a-15b2-4d25-854c-0a3797b8f42e+20:2354:x1876092488115200:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789181643.266762:0:16538:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789181643.266767:0:16538:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f800/0x8f4f7840b2e4277a lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f542 expref: 20 pid: 15740 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181643.266790:0:16538:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f800/0x8f4f7840b2e4277a lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f542 expref: 20 pid: 15740 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181643.266829:0:16538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dc192187c00) 00010000:00010000:0.0:1789181643.266835:0:16538:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e4279d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181643.266845:0:16538:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e4279d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181643.266853:0:16538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e4279d lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181643.266870:0:16538:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789181643.266926:0:16538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1baba5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:049cbf1a-15b2-4d25-854c-0a3797b8f42e+20:2354:x1876092488115200:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 180us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181643.266933:0:16538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 13 00010000:00010000:3.0:1789181643.267504:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f800/0x8f4f7840b2e4277a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f542 expref: 19 pid: 15740 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181643.267521:0:14425:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1988c0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14425:1876092510119936:192.168.204.32@tcp:104: 00010000:00010000:3.0:1789181643.267541:0:14425:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e4279d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181643.267549:0:14425:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e4279d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181643.267555:0:14425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e4279d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789181643.267598:0:14425:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1789181643.267603:0:14425:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789181643.267624:0:14425:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e4279d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181643.267651:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e42796 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f550 expref: 19 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181643.267665:0:14425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e4279d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f550 expref: 18 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181643.267672:0:14425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dc192187c00) 00010000:00010000:3.0:1789181643.267674:0:14425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789181643.267676:0:14425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1bfa1f400, rc 0) 00000100:00100000:3.0:1789181643.267703:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:049cbf1a-15b2-4d25-854c-0a3797b8f42e+18:14534:x1876092488115072:12345-192.168.204.32@tcp:101:bash.0 Request processed in 5047us (5258us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181643.267718:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 43 00000100:00100000:1.0:1789181643.271815:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181643.271898:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488115456 00000100:00100000:3.0:1789181643.271908:0:14410:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488115456 00000100:00100000:3.0:1789181643.271977:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 3 00000100:00100000:3.0:1789181643.271988:0:14410:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb7f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:049cbf1a-15b2-4d25-854c-0a3797b8f42e+18:14534:x1876092488115456:12345-192.168.204.32@tcp:103:bash.0 00010000:00010000:3.0:1789181643.272004:0:14410:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789181643.272030:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e4279d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f550 expref: 18 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181643.272052:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e4278f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f549 expref: 17 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181643.272061:0:14410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dc192187c00) 00010000:00010000:3.0:1789181643.272072:0:14410:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789181643.272126:0:14410:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb7f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:049cbf1a-15b2-4d25-854c-0a3797b8f42e+16:14534:x1876092488115456:12345-192.168.204.32@tcp:103:bash.0 Request processed in 140us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181643.272134:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 3 00000100:00100000:1.0:1789181643.274512:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181643.274632:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488115584 00000100:00100000:0.0:1789181643.274639:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488115584 00000100:00100000:0.0:1789181643.274690:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 44 00000100:00100000:0.0:1789181643.274700:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:049cbf1a-15b2-4d25-854c-0a3797b8f42e+16:14534:x1876092488115584:12345-192.168.204.32@tcp:58:bash.0 00010000:00010000:0.0:1789181643.274823:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890800/0x8f4f7840b2e427a4 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181643.274838:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890800/0x8f4f7840b2e427a4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181643.274851:0:14423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890800/0x8f4f7840b2e427a4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789181643.276629:0:14423:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789181643.277083:0:14423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1789181643.277756:0:14423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1789181643.278291:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:049cbf1a-15b2-4d25-854c-0a3797b8f42e+16:14534:x1876092488115584:12345-192.168.204.32@tcp:58:bash.0 Request processed in 3587us (3782us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181643.278312:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 44 00000100:00100000:2.0:1789181643.281752:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181643.282044:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488115712 00000100:00100000:1.0:1789181643.282055:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488115712 00000100:00100000:1.0:1789181643.282213:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 45 00000100:00100000:1.0:1789181643.282224:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1baba7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:049cbf1a-15b2-4d25-854c-0a3797b8f42e+16:14534:x1876092488115712:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:1.0:1789181643.282244:0:14424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181643.282264:0:14424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab8c00/0x8f4f7840b2e427ab lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f557 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181643.282373:0:14424:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890800/0x8f4f7840b2e427a4 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181643.282385:0:14424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab8c00/0x8f4f7840b2e427ab lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f557 expref: 17 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181643.282407:0:14424:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890800/0x8f4f7840b2e427a4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181643.282421:0:14424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab8c00/0x8f4f7840b2e427ab lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f557 expref: 17 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181643.282450:0:14424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dc18553a600) 00010000:00010000:1.0:1789181643.282453:0:14424:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789181643.282457:0:14424:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab8c00/0x8f4f7840b2e427ab lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f557 expref: 17 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181643.282475:0:14424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1baab8c00, rc 0) 00000100:00100000:1.0:1789181643.282533:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1baba7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:049cbf1a-15b2-4d25-854c-0a3797b8f42e+17:14534:x1876092488115712:12345-192.168.204.32@tcp:101:bash.0 Request processed in 310us (789us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181643.282540:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 45 00000100:00100000:2.0:1789181643.777534:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1baba5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876092510120320:0@lo:400:kworker.0 00000100:00100000:2.0:1789181643.777604:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181643.777658:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1baba7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1876092510120832:0@lo:400:kworker.0 00000100:00100000:2.0:1789181643.777681:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181643.777702:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789181643.777708:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1baba7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876092510120448:0@lo:400:kworker.0 00000100:00100000:2.0:1789181643.777745:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181643.778047:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1baba4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510120064:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789181643.778078:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181643.778105:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1baba5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876092510120576:0@lo:400:kworker.0 00000100:00100000:3.0:1789181643.778125:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181643.778140:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789181643.778144:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1baba4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:486954f1-c2e6-402a-b3c8-096af476560c:3305:1876092510120192:0@lo:400:kworker.0 00000100:00100000:3.0:1789181643.778169:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181643.778191:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1baba5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1876092510120704:0@lo:400:kworker.0 00000100:00100000:3.0:1789181643.778217:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181643.778246:0:15740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510120832 00000100:00100000:3.0:1789181643.778253:0:15740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510120832 00000100:00100000:3.0:1789181643.778309:0:15740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510120576 00000100:00100000:3.0:1789181643.778313:0:15740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510120576 00000100:00100000:3.0:1789181643.778354:0:15740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510120704 00000100:00100000:3.0:1789181643.778357:0:15740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510120704 00000100:00100000:3.0:1789181643.778376:0:15740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789181643.778384:0:15740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1baba6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876092510120832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181643.778431:0:15740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1baba6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876092510120832:12345-0@lo:400:kworker.0 Request processed in 47us (749us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181643.778438:0:15740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789181643.778454:0:15740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789181643.778460:0:15740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1988c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876092510120576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181643.778487:0:15740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1988c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876092510120576:12345-0@lo:400:kworker.0 Request processed in 28us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181643.778492:0:15740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789181643.778501:0:15740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789181643.778506:0:15740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1988c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876092510120704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789181643.778527:0:15740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1988c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876092510120704:12345-0@lo:400:kworker.0 Request processed in 21us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181643.778531:0:15740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789181643.778561:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1baba5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1876092510120704:0@lo:400:kworker.0 00000100:00100000:3.0:1789181643.778570:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1baba5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876092510120576:0@lo:400:kworker.0 00000100:00100000:1.0:1789181643.779404:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510120320 00000100:00100000:1.0:1789181643.779411:0:15106:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510120320 00000100:00100000:1.0:1789181643.779441:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510120448 00000100:00100000:1.0:1789181643.779444:0:15106:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510120448 00000100:00100000:1.0:1789181643.779467:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789181643.779473:0:15106:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1baba5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1876092510120320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181643.779518:0:15106:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1baba5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1876092510120320:12345-0@lo:400:kworker.0 Request processed in 44us (1912us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181643.779523:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789181643.779536:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789181643.779542:0:15106:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1baba4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1876092510120448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181643.779567:0:15106:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1baba4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1876092510120448:12345-0@lo:400:kworker.0 Request processed in 25us (1821us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181643.779572:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789181643.779594:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510120192 00000100:00100000:1.0:1789181643.779597:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510120192 00000100:00100000:1.0:1789181643.779628:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1789181643.779633:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c1ce3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:486954f1-c2e6-402a-b3c8-096af476560c+19:3305:x1876092510120192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789181643.779665:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c1ce3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:486954f1-c2e6-402a-b3c8-096af476560c+19:3305:x1876092510120192:12345-0@lo:400:kworker.0 Request processed in 32us (1495us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181643.779671:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789181643.781548:0:15110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510120064 00000100:00100000:2.0:1789181643.781558:0:15110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510120064 00000100:00100000:2.0:1789181643.781619:0:15110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789181643.781628:0:15110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1988c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510120064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789181643.781658:0:15110:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789181643.781720:0:15110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1988c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510120064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (3641us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181643.781725:0:15110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789181643.781768:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1baba7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876092510120448:0@lo:400:kworker.0 00000100:00100000:2.0:1789181643.781780:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1baba5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876092510120320:0@lo:400:kworker.0 00000100:00100000:2.0:1789181643.781790:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1baba7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1876092510120832:0@lo:400:kworker.0 00000100:00100000:3.0:1789181643.782673:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1baba4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:486954f1-c2e6-402a-b3c8-096af476560c:3305:1876092510120192:0@lo:400:kworker.0 00000100:00100000:3.0:1789181643.782719:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1baba4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510120064:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789181643.789879:0:14419:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789181643.789890:0:14419:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789181643.966604:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789181644.286888:0:14458:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789181644.286898:0:14458:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789181644.286938:0:14458:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1789181644.286952:0:14458:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1789181644.287093:0:14458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c0269500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14458:1876092510120960:192.168.204.32@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789181644.287463:0:14458:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc189de5900 going to sleep for 11 seconds 00000100:00100000:2.0:1789181644.328591:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181644.328697:0:14458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c0269500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14458:1876092510120960:192.168.204.32@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789181644.329216:0:14434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488115840 00000100:00100000:3.0:1789181644.329224:0:14434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488115840 00000100:00100000:3.0:1789181644.329301:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 0 00000100:00100000:3.0:1789181644.329312:0:14434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1baba7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:049cbf1a-15b2-4d25-854c-0a3797b8f42e+17:14537:x1876092488115840:12345-192.168.204.32@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1789181644.329416:0:14434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1baba7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:049cbf1a-15b2-4d25-854c-0a3797b8f42e+17:14537:x1876092488115840:12345-192.168.204.32@tcp:900:lhsmtool_posix.0 Request processed in 106us (834us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181644.329423:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 0 00000100:00080000:0.0:1789181644.329554:0:14419:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789181644.343380:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181644.343735:0:15740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488115968 00000100:00100000:3.0:1789181644.343745:0:15740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488115968 00000100:00100000:3.0:1789181644.343806:0:15740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 46 00000100:00100000:3.0:1789181644.343816:0:15740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1bfb7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:049cbf1a-15b2-4d25-854c-0a3797b8f42e+17:14537:x1876092488115968:12345-192.168.204.32@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789181644.343859:0:15740:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789181644.344353:0:15740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1bfb7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:049cbf1a-15b2-4d25-854c-0a3797b8f42e+17:14537:x1876092488115968:12345-192.168.204.32@tcp:53:lhsmtool_posix.0 Request processed in 516us (1013us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181644.344361:0:15740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 46 00000100:00100000:2.0:1789181644.367656:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181644.368610:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488116096 00000100:00100000:1.0:1789181644.368622:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488116096 00000100:00100000:1.0:1789181644.368684:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 47 00000100:00100000:1.0:1789181644.368696:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1baba5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:049cbf1a-15b2-4d25-854c-0a3797b8f42e+17:14537:x1876092488116096:12345-192.168.204.32@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789181644.368764:0:14424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab8200/0x8f4f7840b2e427b2 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181644.368782:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab8200/0x8f4f7840b2e427b2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181644.368795:0:14424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab8200/0x8f4f7840b2e427b2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181644.368866:0:14424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab9400/0x8f4f7840b2e427b9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181644.368874:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab9400/0x8f4f7840b2e427b9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181644.368881:0:14424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab9400/0x8f4f7840b2e427b9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181644.368901:0:14424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab9800/0x8f4f7840b2e427c0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181644.368922:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab9800/0x8f4f7840b2e427c0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181644.368929:0:14424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab9800/0x8f4f7840b2e427c0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789181644.368992:0:14424:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1789181644.368996:0:14424:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789181644.369012:0:14424:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab9800/0x8f4f7840b2e427c0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181644.369023:0:14424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab8200/0x8f4f7840b2e427b2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181644.369030:0:14424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab8200/0x8f4f7840b2e427b2 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181644.369036:0:14424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab8200/0x8f4f7840b2e427b2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181644.369041:0:14424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1baab8200 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:1.0:1789181644.369045:0:14424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab8200/0x8f4f7840b2e427b2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181644.369053:0:14424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab8200/0x8f4f7840b2e427b2 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181644.369065:0:14424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9dc18553af00) 00010000:00010000:1.0:1789181644.369068:0:14424:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789181644.369073:0:14424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab8200/0x8f4f7840b2e427b2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181644.369089:0:14424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab8200/0x8f4f7840b2e427b2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181644.369103:0:14424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab9400/0x8f4f7840b2e427b9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181644.369109:0:14424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab9400/0x8f4f7840b2e427b9 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181644.369115:0:14424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab9400/0x8f4f7840b2e427b9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181644.369120:0:14424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1baab9400 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:1.0:1789181644.369123:0:14424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab9400/0x8f4f7840b2e427b9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181644.369128:0:14424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab9400/0x8f4f7840b2e427b9 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181644.369135:0:14424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9dc19bc16c00) 00010000:00010000:1.0:1789181644.369138:0:14424:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789181644.369140:0:14424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab9400/0x8f4f7840b2e427b9 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181644.369145:0:14424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab9400/0x8f4f7840b2e427b9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181644.369157:0:14424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab9800/0x8f4f7840b2e427c0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181644.369162:0:14424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab9800/0x8f4f7840b2e427c0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181644.369174:0:14424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab9800/0x8f4f7840b2e427c0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181644.369179:0:14424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1baab9800 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:1.0:1789181644.369182:0:14424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab9800/0x8f4f7840b2e427c0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181644.369187:0:14424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab9800/0x8f4f7840b2e427c0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181644.369194:0:14424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dc18553a600) 00010000:00010000:1.0:1789181644.369197:0:14424:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789181644.369199:0:14424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab9800/0x8f4f7840b2e427c0 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181644.369205:0:14424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab9800/0x8f4f7840b2e427c0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181644.369296:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1baba5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:049cbf1a-15b2-4d25-854c-0a3797b8f42e+17:14537:x1876092488116096:12345-192.168.204.32@tcp:34:lhsmtool_posix.0 Request processed in 591us (1638us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181644.369304:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 47 00000100:00100000:2.0:1789181644.372450:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181644.372547:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488116352 00000100:00100000:0.0:1789181644.372557:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488116352 00000100:00100000:0.0:1789181644.372621:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 48 00000100:00100000:0.0:1789181644.372632:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1baba7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:049cbf1a-15b2-4d25-854c-0a3797b8f42e+17:14537:x1876092488116352:12345-192.168.204.32@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789181644.372649:0:14425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181644.372667:0:14425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890a00/0x8f4f7840b2e427c7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f55e expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181644.372763:0:14425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890c00/0x8f4f7840b2e427ce lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181644.372777:0:14425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890c00/0x8f4f7840b2e427ce lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181644.372789:0:14425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890c00/0x8f4f7840b2e427ce lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789181644.372812:0:14425:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789181644.372916:0:14425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890c00/0x8f4f7840b2e427ce lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181644.372925:0:14425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890c00/0x8f4f7840b2e427ce lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181644.372939:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890c00/0x8f4f7840b2e427ce lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181644.372946:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc189890c00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:0.0:1789181644.372950:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890c00/0x8f4f7840b2e427ce lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181644.372958:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890c00/0x8f4f7840b2e427ce lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181644.372969:0:14425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dc18553a600) 00010000:00010000:0.0:1789181644.372972:0:14425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789181644.372985:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890c00/0x8f4f7840b2e427ce lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181644.372991:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890c00/0x8f4f7840b2e427ce lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181644.373031:0:14425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890a00/0x8f4f7840b2e427c7 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f55e expref: 19 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181644.373042:0:14425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9dc18553af00) 00010000:00010000:0.0:1789181644.373045:0:14425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789181644.373056:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890a00/0x8f4f7840b2e427c7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f55e expref: 19 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181644.373066:0:14425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc189890a00, rc 0) 00000100:00100000:0.0:1789181644.373124:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1baba7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:049cbf1a-15b2-4d25-854c-0a3797b8f42e+18:14537:x1876092488116352:12345-192.168.204.32@tcp:101:lhsmtool_posix.0 Request processed in 495us (684us total) trans 8589934619 rc 301/301 00000100:00100000:0.0:1789181644.373131:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 48 00000100:00100000:2.0:1789181644.383524:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181644.383801:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488116480 00000100:00100000:1.0:1789181644.383811:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488116480 00000100:00100000:1.0:1789181644.383869:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 49 00000100:00100000:1.0:1789181644.383880:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1baba4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:049cbf1a-15b2-4d25-854c-0a3797b8f42e+18:14537:x1876092488116480:12345-192.168.204.32@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789181644.383913:0:14424:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789181644.384068:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1baba4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:049cbf1a-15b2-4d25-854c-0a3797b8f42e+18:14537:x1876092488116480:12345-192.168.204.32@tcp:53:lhsmtool_posix.0 Request processed in 190us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181644.384085:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 49 00000100:00100000:2.0:1789181644.394213:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181644.394308:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488116736 00000100:00100000:0.0:1789181644.394325:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488116736 00000100:00100000:0.0:1789181644.394402:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 50 00000100:00100000:0.0:1789181644.394411:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1baba4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:049cbf1a-15b2-4d25-854c-0a3797b8f42e+18:14537:x1876092488116736:12345-192.168.204.32@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789181644.394430:0:14425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181644.394448:0:14425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890a00/0x8f4f7840b2e427dc lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f565 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789181644.396467:0:14425:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x6:0x0], count =28 00000004:00080000:0.0:1789181644.396477:0:14425:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x6:0x0]+28 in llog 00000004:00080000:0.0:1789181644.396538:0:14425:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:0.0:1789181644.396845:0:14425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890c00/0x8f4f7840b2e427e3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181644.396862:0:14425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890c00/0x8f4f7840b2e427e3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181644.396874:0:14425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890c00/0x8f4f7840b2e427e3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181644.397307:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890a00/0x8f4f7840b2e427dc lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f565 expref: 21 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181644.397377:0:14425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890c00/0x8f4f7840b2e427e3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f565 expref: 20 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181644.397387:0:14425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9dc18553a200) 00010000:00010000:0.0:1789181644.397390:0:14425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789181644.397393:0:14425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc189890c00, rc 0) 00000100:00100000:0.0:1789181644.397466:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1baba4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:049cbf1a-15b2-4d25-854c-0a3797b8f42e+20:14537:x1876092488116736:12345-192.168.204.32@tcp:101:lhsmtool_posix.0 Request processed in 3054us (3261us total) trans 8589934620 rc 0/0 00000100:00100000:0.0:1789181644.397475:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 50 00000100:00100000:2.0:1789181644.406447:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181644.406610:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488116992 00000100:00100000:1.0:1789181644.406622:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488116992 00000100:00100000:1.0:1789181644.406683:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 51 00000100:00100000:1.0:1789181644.406693:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1baba5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:049cbf1a-15b2-4d25-854c-0a3797b8f42e+20:14537:x1876092488116992:12345-192.168.204.32@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789181644.406751:0:14424:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789181644.406789:0:14424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890c00/0x8f4f7840b2e427e3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f565 expref: 20 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181644.406807:0:14424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9dc18553a200) 00010000:00010000:1.0:1789181644.406817:0:14424:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789181644.406841:0:14424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab9800/0x8f4f7840b2e427f1 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181644.406854:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab9800/0x8f4f7840b2e427f1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181644.406863:0:14424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab9800/0x8f4f7840b2e427f1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181644.406877:0:14424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab9400/0x8f4f7840b2e427f8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xf54ff742 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181644.406883:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab9400/0x8f4f7840b2e427f8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf54ff742 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181644.406890:0:14424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab9400/0x8f4f7840b2e427f8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf54ff742 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181644.407662:0:14424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab9800/0x8f4f7840b2e427f1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181644.407675:0:14424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab9800/0x8f4f7840b2e427f1 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181644.407682:0:14424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab9800/0x8f4f7840b2e427f1 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181644.407689:0:14424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1baab9800 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:1.0:1789181644.407693:0:14424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab9800/0x8f4f7840b2e427f1 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181644.407701:0:14424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab9800/0x8f4f7840b2e427f1 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181644.407711:0:14424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9dc19bc16200) 00010000:00010000:1.0:1789181644.407714:0:14424:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789181644.407719:0:14424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab9800/0x8f4f7840b2e427f1 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181644.407725:0:14424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab9800/0x8f4f7840b2e427f1 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181644.407734:0:14424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab9400/0x8f4f7840b2e427f8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf54ff742 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181644.407740:0:14424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab9400/0x8f4f7840b2e427f8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf54ff742 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181644.407746:0:14424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab9400/0x8f4f7840b2e427f8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf54ff742 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181644.407768:0:14424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1baab9400 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:1.0:1789181644.407771:0:14424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab9400/0x8f4f7840b2e427f8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf54ff742 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181644.407778:0:14424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab9400/0x8f4f7840b2e427f8 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf54ff742 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181644.407786:0:14424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xf54ff742 (ffff9dc19bc16c00) 00010000:00010000:1.0:1789181644.407789:0:14424:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789181644.407791:0:14424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab9400/0x8f4f7840b2e427f8 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xf54ff742 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181644.407797:0:14424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab9400/0x8f4f7840b2e427f8 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xf54ff742 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181644.407890:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1baba5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:049cbf1a-15b2-4d25-854c-0a3797b8f42e+19:14537:x1876092488116992:12345-192.168.204.32@tcp:36:lhsmtool_posix.0 Request processed in 1197us (1451us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789181644.407898:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 51 00000100:00100000:2.0:1789181644.423198:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181644.423357:0:15740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488117120 00000100:00100000:3.0:1789181644.423368:0:15740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488117120 00000100:00100000:3.0:1789181644.423426:0:15740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 52 00000100:00100000:3.0:1789181644.423436:0:15740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1baba5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:049cbf1a-15b2-4d25-854c-0a3797b8f42e+19:14537:x1876092488117120:12345-192.168.204.32@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789181644.423455:0:15740:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181644.423476:0:15740:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e427ff lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f56c expref: -99 pid: 15740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181644.423518:0:15740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e42806 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181644.423541:0:15740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e42806 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181644.423552:0:15740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e42806 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181644.423639:0:15740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e427ff lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f56c expref: 21 pid: 15740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181644.423657:0:15740:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1ee00/0x8f4f7840b2e42806 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f56c expref: 20 pid: 15740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181644.423666:0:15740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9dc192187c00) 00010000:00010000:3.0:1789181644.423668:0:15740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789181644.423672:0:15740:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1bfa1ee00, rc 0) 00000100:00100000:3.0:1789181644.423730:0:15740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1baba5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:049cbf1a-15b2-4d25-854c-0a3797b8f42e+20:14537:x1876092488117120:12345-192.168.204.32@tcp:101:lhsmtool_posix.0 Request processed in 296us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181644.423737:0:15740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 52 00000100:00100000:2.0:1789181644.429411:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181644.430047:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488117376 00000100:00100000:0.0:1789181644.430058:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488117376 00000100:00100000:0.0:1789181644.430118:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 53 00000100:00100000:0.0:1789181644.430130:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1baba4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:049cbf1a-15b2-4d25-854c-0a3797b8f42e+20:14537:x1876092488117376:12345-192.168.204.32@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789181644.430207:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890a00/0x8f4f7840b2e4280d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181644.430222:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890a00/0x8f4f7840b2e4280d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181644.430233:0:14423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890a00/0x8f4f7840b2e4280d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789181644.431170:0:14423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:0.0:1789181644.431183:0:14423:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 536687852073ns, next at 537687849582ns, rc = 0 00000004:00010000:0.0:1789181644.431272:0:14423:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ca4a09ac reply state 0000000023d3f725 transno 8589934621 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890a00/0x8f4f7840b2e4280d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181644.431313:0:14423:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789181644.431453:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1baba4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:049cbf1a-15b2-4d25-854c-0a3797b8f42e+22:14537:x1876092488117376:12345-192.168.204.32@tcp:36:lhsmtool_posix.0 Request processed in 1324us (2050us total) trans 8589934621 rc 0/0 00000100:00100000:0.0:1789181644.431461:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 53 00010000:00010000:0.0:1789181644.444181:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890a00/0x8f4f7840b2e4280d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181644.444200:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890a00/0x8f4f7840b2e4280d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181644.444207:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890a00/0x8f4f7840b2e4280d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181644.444212:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc189890a00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:0.0:1789181644.444216:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890a00/0x8f4f7840b2e4280d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181644.444223:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890a00/0x8f4f7840b2e4280d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181644.444239:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9dc192187c00) 00010000:00010000:0.0:1789181644.444242:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789181644.444247:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890a00/0x8f4f7840b2e4280d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181644.444253:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890a00/0x8f4f7840b2e4280d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181644.446456:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181644.446684:0:15740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488117504 00000100:00100000:3.0:1789181644.446704:0:15740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488117504 00000100:00100000:3.0:1789181644.446765:0:15740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 54 00000100:00100000:3.0:1789181644.446779:0:15740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b66ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:049cbf1a-15b2-4d25-854c-0a3797b8f42e+21:14537:x1876092488117504:12345-192.168.204.32@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789181644.446802:0:15740:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181644.446820:0:15740:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e42814 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f573 expref: -99 pid: 15740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181644.446886:0:15740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e42814 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f573 expref: 22 pid: 15740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181644.446915:0:15740:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e42814 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f573 expref: 22 pid: 15740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181644.446942:0:15740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9dc192187c00) 00010000:00010000:3.0:1789181644.446945:0:15740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789181644.446948:0:15740:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1bfa1f400, rc 0) 00000100:00100000:3.0:1789181644.447005:0:15740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b66ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:049cbf1a-15b2-4d25-854c-0a3797b8f42e+22:14537:x1876092488117504:12345-192.168.204.32@tcp:101:lhsmtool_posix.0 Request processed in 229us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181644.447012:0:15740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 54 00000100:00100000:2.0:1789181644.454230:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181644.454367:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488117632 00000100:00100000:0.0:1789181644.454376:0:15107:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488117632 00000100:00100000:0.0:1789181644.454460:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 11 00000100:00100000:0.0:1789181644.454469:0:15107:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b66dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:049cbf1a-15b2-4d25-854c-0a3797b8f42e+5:2354:x1876092488117632:12345-192.168.204.32@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1789181644.454825:0:15107:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b66dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:049cbf1a-15b2-4d25-854c-0a3797b8f42e+6:2354:x1876092488117632:12345-192.168.204.32@tcp:2:lhsmtool_posix.0 Request processed in 358us (604us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1789181644.454832:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 11 00000100:00080000:2.0:1789181644.455648:0:14419:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789181644.469474:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181644.473220:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488117888 00000100:00100000:3.0:1789181644.473235:0:14427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488117888 00000100:00100000:3.0:1789181644.473399:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 11 00000100:00100000:3.0:1789181644.473410:0:14427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b66dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:049cbf1a-15b2-4d25-854c-0a3797b8f42e+22:14537:x1876092488117888:12345-192.168.204.32@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789181644.473654:0:14427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b66dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:049cbf1a-15b2-4d25-854c-0a3797b8f42e+23:14537:x1876092488117888:12345-192.168.204.32@tcp:35:lhsmtool_posix.0 Request processed in 246us (4188us total) trans 8589934622 rc 0/0 00000100:00100000:3.0:1789181644.473661:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 11 00000100:00100000:2.0:1789181644.477685:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181644.477908:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488118144 00000100:00100000:1.0:1789181644.477980:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488118144 00000100:00100000:1.0:1789181644.478140:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 55 00000100:00100000:1.0:1789181644.478151:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b66dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:049cbf1a-15b2-4d25-854c-0a3797b8f42e+23:14537:x1876092488118144:12345-192.168.204.32@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789181644.478296:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b66dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:049cbf1a-15b2-4d25-854c-0a3797b8f42e+23:14537:x1876092488118144:12345-192.168.204.32@tcp:57:lhsmtool_posix.0 Request processed in 147us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181644.478303:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 55 00000100:00100000:2.0:1789181644.482393:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181644.482566:0:15740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488118272 00000100:00100000:3.0:1789181644.482576:0:15740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488118272 00000100:00100000:3.0:1789181644.482814:0:15740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 56 00000100:00100000:3.0:1789181644.482826:0:15740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b66df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:049cbf1a-15b2-4d25-854c-0a3797b8f42e+23:14537:x1876092488118272:12345-192.168.204.32@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789181644.482857:0:15740:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789181644.482879:0:15740:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f800/0x8f4f7840b2e4281b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f57a expref: -99 pid: 15740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181644.482948:0:15740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f200/0x8f4f7840b2e42822 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181644.482969:0:15740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f200/0x8f4f7840b2e42822 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181644.482980:0:15740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f200/0x8f4f7840b2e42822 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789181644.483018:0:15740:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789181644.483048:0:15740:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f200/0x8f4f7840b2e42822 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181644.483074:0:15740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f800/0x8f4f7840b2e4281b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f57a expref: 25 pid: 15740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181644.483094:0:15740:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f200/0x8f4f7840b2e42822 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f57a expref: 24 pid: 15740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181644.483101:0:15740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9dc192187c00) 00010000:00010000:3.0:1789181644.483104:0:15740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789181644.483107:0:15740:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1bfa1f200, rc 0) 00000100:00100000:3.0:1789181644.483165:0:15740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b66df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:049cbf1a-15b2-4d25-854c-0a3797b8f42e+24:14537:x1876092488118272:12345-192.168.204.32@tcp:101:lhsmtool_posix.0 Request processed in 342us (858us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181644.483172:0:15740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 56 00000100:00100000:2.0:1789181644.486964:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181644.487147:0:16649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488118400 00000100:00100000:1.0:1789181644.487158:0:16649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488118400 00000100:00100000:1.0:1789181644.487260:0:16649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 12 00000100:00100000:1.0:1789181644.487270:0:16649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b66dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:049cbf1a-15b2-4d25-854c-0a3797b8f42e+6:2353:x1876092488118400:12345-192.168.204.32@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789181644.487299:0:16649:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181644.487561:0:16649:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f5c7fada/0x8f4f7840b2e42829 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f581 expref: -99 pid: 16649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789181644.487590:0:16649:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa4becd, blocks: 0x1 00010000:00010000:1.0:1789181644.487622:0:16649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=536s v=(0 0) 00010000:00010000:1.0:1789181644.487626:0:16649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789181644.487637:0:16649:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f5c7fada/0x8f4f7840b2e42829 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f581 expref: 7 pid: 16649 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181644.487656:0:16649:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f5c7fada/0x8f4f7840b2e42829 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f581 expref: 7 pid: 16649 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181644.487669:0:16649:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1baab9400, rc 0) 00000100:00100000:1.0:1789181644.487742:0:16649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b66dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:049cbf1a-15b2-4d25-854c-0a3797b8f42e+7:2353:x1876092488118400:12345-192.168.204.32@tcp:101:lhsmtool_posix.0 Request processed in 473us (786us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181644.487749:0:16649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 12 00000100:00100000:3.0:1789181644.490699:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181644.492419:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488118656 00000100:00100000:0.0:1789181644.492434:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488118656 00000100:00100000:0.0:1789181644.492512:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 57 00000100:00100000:0.0:1789181644.492522:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1988c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:049cbf1a-15b2-4d25-854c-0a3797b8f42e+24:14537:x1876092488118656:12345-192.168.204.32@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789181644.492820:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1988c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:049cbf1a-15b2-4d25-854c-0a3797b8f42e+24:14537:x1876092488118656:12345-192.168.204.32@tcp:57:lhsmtool_posix.0 Request processed in 298us (2138us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181644.492828:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 57 00000100:00100000:3.0:1789181644.496225:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181644.497226:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488118784 00000100:00100000:0.0:1789181644.497237:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488118784 00000100:00100000:0.0:1789181644.497299:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 58 00000100:00100000:0.0:1789181644.497310:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1988c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:049cbf1a-15b2-4d25-854c-0a3797b8f42e+24:14537:x1876092488118784:12345-192.168.204.32@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1789181644.631237:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934621 is committed 00000004:00080000:2.0:1789181644.631251:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:2.0:1789181644.631309:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000100:00100000:0.0:1789181644.631573:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1988c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:049cbf1a-15b2-4d25-854c-0a3797b8f42e+13:14537:x1876092488118784:12345-192.168.204.32@tcp:44:lhsmtool_posix.0 Request processed in 134258us (135349us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181644.631585:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 58 00000100:00100000:0.0:1789181644.634371:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc19c36c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876092510121088:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1789181644.634436:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181644.634661:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181644.635234:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510121088 00000100:00100000:0.0:1789181644.635243:0:15107:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510121088 00000100:00100000:0.0:1789181644.635324:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488118912 00000100:00100000:0.0:1789181644.635327:0:15107:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488118912 00000100:00100000:0.0:1789181644.635368:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789181644.635392:0:15107:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c0269500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876092510121088:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1789181644.635558:0:15107:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1789181644.635563:0:15107:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1789181644.635565:0:15107:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789181644.635567:0:15107:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1789181645 -> 1789181645 00002000:00010000:0.0:1789181644.635570:0:15107:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1789181644.635620:0:15107:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c0269500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3304:x1876092510121088:12345-0@lo:2:osp-syn-0-0.0 Request processed in 230us (1185us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1789181644.635628:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789181644.635645:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 14 00000100:00100000:0.0:1789181644.635652:0:15107:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b66dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:049cbf1a-15b2-4d25-854c-0a3797b8f42e+7:2354:x1876092488118912:12345-192.168.204.32@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1789181644.637963:0:15107:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b66dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:049cbf1a-15b2-4d25-854c-0a3797b8f42e+7:2354:x1876092488118912:12345-192.168.204.32@tcp:16:lhsmtool_posix.0 Request processed in 2299us (3291us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181644.637978:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 14 00000100:00080000:2.0:1789181644.639519:0:14419:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1789181644.639846:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9dc19c36c000/2, rc 0, transno 8589934595 00000100:00100000:0.0:1789181644.639858:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc19c36c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876092510121088:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789181644.655361:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181644.655679:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488119168 00000100:00100000:0.0:1789181644.655699:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488119168 00000100:00100000:0.0:1789181644.655759:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 59 00000100:00100000:0.0:1789181644.655769:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b66dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:049cbf1a-15b2-4d25-854c-0a3797b8f42e+13:14537:x1876092488119168:12345-192.168.204.32@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789181644.655817:0:14423:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789181644.655854:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f200/0x8f4f7840b2e42822 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f57a expref: 13 pid: 15740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181644.655873:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9dc192187c00) 00010000:00010000:0.0:1789181644.655892:0:14423:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789181644.655933:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890a00/0x8f4f7840b2e42830 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181644.655948:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890a00/0x8f4f7840b2e42830 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181644.655958:0:14423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890a00/0x8f4f7840b2e42830 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789181644.656430:0:14423:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000841aa7de reply state 00000000401a2094 transno 8589934623 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890a00/0x8f4f7840b2e42830 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181644.656440:0:14423:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789181644.656529:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b66dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:049cbf1a-15b2-4d25-854c-0a3797b8f42e+14:14537:x1876092488119168:12345-192.168.204.32@tcp:36:lhsmtool_posix.0 Request processed in 760us (1197us total) trans 8589934623 rc 0/0 00000100:00100000:0.0:1789181644.656537:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 59 00010000:00010000:1.0:1789181644.661241:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890a00/0x8f4f7840b2e42830 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181644.661260:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890a00/0x8f4f7840b2e42830 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181644.661267:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890a00/0x8f4f7840b2e42830 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181644.661301:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc189890a00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:1.0:1789181644.661306:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890a00/0x8f4f7840b2e42830 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181644.661322:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890a00/0x8f4f7840b2e42830 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181644.661358:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9dc192187c00) 00010000:00010000:1.0:1789181644.661362:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789181644.661367:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890a00/0x8f4f7840b2e42830 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181644.661373:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890a00/0x8f4f7840b2e42830 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181644.662267:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181644.662828:0:16649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488119296 00000100:00100000:1.0:1789181644.662849:0:16649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488119296 00000100:00100000:1.0:1789181644.662905:0:16649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 15 00000100:00100000:1.0:1789181644.662916:0:16649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b66ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:049cbf1a-15b2-4d25-854c-0a3797b8f42e+7:14537:x1876092488119296:12345-192.168.204.32@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789181644.662933:0:16649:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181644.662952:0:16649:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bac644ee/0x8f4f7840b2e42837 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f588 expref: -99 pid: 16649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181644.662984:0:16649:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f5c7fada/0x8f4f7840b2e42829 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f581 expref: 8 pid: 16649 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181644.662993:0:16649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789181644.662998:0:16649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789181644.663015:0:16649:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bac644ee/0x8f4f7840b2e42837 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f588 expref: 8 pid: 16649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181644.663062:0:16649:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f5c7fada/0x8f4f7840b2e42829 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f581 expref: 8 pid: 16649 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181644.663076:0:16649:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f5c7fada/0x8f4f7840b2e42829 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f581 expref: 8 pid: 16649 timeout: 636 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789181644.663091:0:16649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1bfb7c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:16649:1876092510121216:192.168.204.32@tcp:104: 00000100:00100000:1.0:1789181644.663183:0:16649:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc19c38d0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789181644.666719:0:16649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1bfb7c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:16649:1876092510121216:192.168.204.32@tcp:104: 00010000:00010000:1.0:1789181644.666755:0:16649:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bac644ee/0x8f4f7840b2e42837 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f588 expref: 8 pid: 16649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181644.666776:0:16649:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1baab9800, rc 0) 00000100:00100000:1.0:1789181644.666843:0:16649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b66ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:049cbf1a-15b2-4d25-854c-0a3797b8f42e+8:14537:x1876092488119296:12345-192.168.204.32@tcp:101:lhsmtool_posix.0 Request processed in 3919us (4572us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181644.666853:0:16649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 15 00000100:00100000:2.0:1789181644.669061:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181644.669200:0:16538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488119424 00000100:00100000:0.0:1789181644.669209:0:16538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488119424 00010000:00010000:0.0:1789181644.669248:0:16538:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f5c7fada/0x8f4f7840b2e42829 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f581 expref: 8 pid: 16649 timeout: 636 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181644.669297:0:16538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 14 00000100:00100000:0.0:1789181644.669306:0:16538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b66dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:049cbf1a-15b2-4d25-854c-0a3797b8f42e+8:2353:x1876092488119424:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789181644.669328:0:16538:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789181644.669382:0:16538:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f5c7fada/0x8f4f7840b2e42829 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f581 expref: 8 pid: 16649 timeout: 636 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181644.669395:0:16538:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f5c7fada/0x8f4f7840b2e42829 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f581 expref: 8 pid: 16649 timeout: 636 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181644.669431:0:16538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f5c7fada/0x8f4f7840b2e42829 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f581 expref: 8 pid: 16649 timeout: 636 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181644.669450:0:16538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789181644.669455:0:16538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789181644.669461:0:16538:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bac644ee/0x8f4f7840b2e42837 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f588 expref: 7 pid: 16649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181644.669475:0:16538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bac644ee/0x8f4f7840b2e42837 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f588 expref: 7 pid: 16649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181644.669511:0:16538:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000bac644ee/0x8f4f7840b2e42837 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f588 expref: 7 pid: 16649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181644.669526:0:16538:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c0268e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:16538:1876092510121344:192.168.204.32@tcp:105: 00000100:00100000:0.0:1789181644.669653:0:16538:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1c03ce840 going to sleep for 11 seconds 00000100:00100000:2.0:1789181644.678365:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181644.678478:0:16538:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c0268e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:16538:1876092510121344:192.168.204.32@tcp:105: 00010000:00010000:0.0:1789181644.678501:0:16538:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789181644.678551:0:16538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b66dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:049cbf1a-15b2-4d25-854c-0a3797b8f42e+7:2353:x1876092488119424:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 9246us (9498us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181644.678562:0:16538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 14 00000100:00100000:3.0:1789181644.678640:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488119552 00000100:00100000:3.0:1789181644.678648:0:15107:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488119552 00000100:00100000:3.0:1789181644.678703:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 16 00000100:00100000:3.0:1789181644.678713:0:15107:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b66de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:049cbf1a-15b2-4d25-854c-0a3797b8f42e+7:2354:x1876092488119552:12345-192.168.204.32@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789181644.678910:0:15107:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1789181644.678914:0:15107:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1789181644 00002000:00010000:3.0:1789181644.678929:0:15107:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1789181642 00002000:00010000:3.0:1789181644.678931:0:15107:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1789181645 -> 1789181644 00002000:00010000:3.0:1789181644.678934:0:15107:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1789181644.678960:0:15107:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b66de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:049cbf1a-15b2-4d25-854c-0a3797b8f42e+8:2354:x1876092488119552:12345-192.168.204.32@tcp:2:lhsmtool_posix.0 Request processed in 249us (647us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1789181644.678967:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 16 00000100:00100000:2.0:1789181644.682623:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181644.683298:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488119680 00000100:00100000:0.0:1789181644.683309:0:15106:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488119680 00000100:00100000:0.0:1789181644.683549:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 17 00000100:00100000:0.0:1789181644.683571:0:15106:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b66df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:049cbf1a-15b2-4d25-854c-0a3797b8f42e+8:2352:x1876092488119680:12345-192.168.204.32@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789181644.683614:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000086b918f1/0x8f4f7840b2e4283e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181644.683634:0:15106:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bac644ee/0x8f4f7840b2e42837 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f588 expref: 8 pid: 16649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181644.683644:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789181644.683649:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789181644.683654:0:15106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000086b918f1/0x8f4f7840b2e4283e lrc: 4/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181644.683697:0:15106:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bac644ee/0x8f4f7840b2e42837 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f588 expref: 8 pid: 16649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181644.683712:0:15106:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bac644ee/0x8f4f7840b2e42837 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f588 expref: 8 pid: 16649 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181644.683727:0:15106:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1c0268e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:15106:1876092510121472:192.168.204.32@tcp:104: 00000100:00100000:0.0:1789181644.683808:0:15106:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1c03ce840 going to sleep for 11 seconds 00000100:00100000:2.0:1789181644.686974:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181644.687286:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488119808 00000100:00100000:3.0:1789181644.687296:0:14410:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488119808 00010000:00010000:3.0:1789181644.687370:0:14410:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bac644ee/0x8f4f7840b2e42837 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f588 expref: 9 pid: 16649 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181644.687403:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 15 00000100:00100000:3.0:1789181644.687413:0:14410:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b66dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:049cbf1a-15b2-4d25-854c-0a3797b8f42e+9:2354:x1876092488119808:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789181644.687428:0:14410:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789181644.687450:0:14410:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bac644ee/0x8f4f7840b2e42837 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f588 expref: 9 pid: 16649 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181644.687464:0:14410:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bac644ee/0x8f4f7840b2e42837 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f588 expref: 9 pid: 16649 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181644.687488:0:14410:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789181644.687492:0:14410:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789181644.687499:0:14410:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000086b918f1/0x8f4f7840b2e4283e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181644.687524:0:14410:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000086b918f1/0x8f4f7840b2e4283e lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181644.687546:0:14410:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789181644.687603:0:14410:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b66dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:049cbf1a-15b2-4d25-854c-0a3797b8f42e+9:2354:x1876092488119808:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 192us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1789181644.687611:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 15 00010000:00010000:0.0:1789181644.688272:0:15106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bac644ee/0x8f4f7840b2e42837 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f588 expref: 8 pid: 16649 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181644.688300:0:15106:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1c0268e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:15106:1876092510121472:192.168.204.32@tcp:104: 00010000:00010000:0.0:1789181644.688382:0:15106:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000086b918f1/0x8f4f7840b2e4283e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181644.688401:0:15106:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000086b918f1/0x8f4f7840b2e4283e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181644.688408:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000086b918f1/0x8f4f7840b2e4283e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181644.688433:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000086b918f1/0x8f4f7840b2e4283e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181644.688441:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000086b918f1/0x8f4f7840b2e4283e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181644.688450:0:15106:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000086b918f1/0x8f4f7840b2e4283e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181644.688456:0:15106:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc189890c00 already unused, calling callback (ffffffffc152f9b0) 00010000:00010000:0.0:1789181644.688460:0:15106:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000086b918f1/0x8f4f7840b2e4283e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181644.688469:0:15106:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000086b918f1/0x8f4f7840b2e4283e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181644.688483:0:15106:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000086b918f1/0x8f4f7840b2e4283e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181644.688502:0:15106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000086b918f1/0x8f4f7840b2e4283e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181644.688566:0:15106:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b66df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:049cbf1a-15b2-4d25-854c-0a3797b8f42e+7:2352:x1876092488119680:12345-192.168.204.32@tcp:1:lhsmtool_posix.0 Request processed in 4997us (5952us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181644.688574:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 17 00000100:00100000:2.0:1789181644.695578:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181644.695661:0:15740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488120064 00000100:00100000:3.0:1789181644.695672:0:15740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488120064 00000100:00100000:3.0:1789181644.695827:0:15740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 60 00000100:00100000:3.0:1789181644.695848:0:15740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b66dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:049cbf1a-15b2-4d25-854c-0a3797b8f42e+13:14537:x1876092488120064:12345-192.168.204.32@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789181644.695928:0:15740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f800/0x8f4f7840b2e42845 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181644.695944:0:15740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f800/0x8f4f7840b2e42845 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181644.695955:0:15740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f800/0x8f4f7840b2e42845 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181644.696199:0:15740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e4284c lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181644.696211:0:15740:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e42814 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f573 expref: 14 pid: 15740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181644.696219:0:15740:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e4284c lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181644.696260:0:15740:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e42814 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f573 expref: 14 pid: 15740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181644.696274:0:15740:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e42814 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f573 expref: 14 pid: 15740 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789181644.696300:0:15740:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc19c36df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15740:1876092510121600:192.168.204.32@tcp:104: 00000100:00100000:3.0:1789181644.696524:0:15740:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc18392e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789181644.699156:0:15740:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc19c36df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15740:1876092510121600:192.168.204.32@tcp:104: 00010000:00010000:3.0:1789181644.699183:0:15740:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e4284c lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181644.701640:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181644.701855:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488120192 00000100:00100000:0.0:1789181644.701865:0:14408:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488120192 00010000:00010000:0.0:1789181644.701906:0:14408:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e42814 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f573 expref: 15 pid: 15740 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181644.701947:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 16 00000100:00100000:0.0:1789181644.701957:0:14408:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b6e3c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:049cbf1a-15b2-4d25-854c-0a3797b8f42e+15:2353:x1876092488120192:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789181644.701974:0:14408:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789181644.701981:0:14408:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e42814 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f573 expref: 15 pid: 15740 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181644.701992:0:14408:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e42814 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f573 expref: 15 pid: 15740 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181644.702012:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f400/0x8f4f7840b2e42814 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f573 expref: 15 pid: 15740 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181644.702039:0:14408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9dc192187c00) 00010000:00010000:0.0:1789181644.702044:0:14408:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e4284c lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181644.702065:0:14408:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e4284c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181644.702072:0:14408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e4284c lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181644.702098:0:14408:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789181644.702169:0:14408:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b6e3c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:049cbf1a-15b2-4d25-854c-0a3797b8f42e+14:2353:x1876092488120192:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 214us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181644.702176:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 16 00010000:00010000:3.0:1789181644.702809:0:15740:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e4284c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181644.702819:0:15740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e4284c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789181644.703043:0:15740:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:3.0:1789181644.703194:0:15740:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000001:00080000:3.0:1789181644.703237:0:15740:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934626 00000100:00100000:3.0:1789181644.703646:0:15740:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc19c36df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:15740:1876092510121728:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789181644.703820:0:15740:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789181644.703952:0:15740:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc18392ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1789181644.705471:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510121728 00000100:00100000:1.0:1789181644.705482:0:14428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510121728 00000100:00100000:1.0:1789181644.705580:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789181644.705604:0:14428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc19c36c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:15740:x1876092510121728:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789181644.705729:0:14428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc19c36c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:15740:x1876092510121728:12345-0@lo:1000:mdt00_003.0 Request processed in 140us (1909us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181644.705750:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789181644.705814:0:15740:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc19c36df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:15740:1876092510121728:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1789181644.706748:0:15740:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000100:00100000:3.0:1789181644.706830:0:15740:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc19c36df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:15740:1876092510121856:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789181644.706879:0:15740:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789181644.707776:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510121856 00000100:00100000:2.0:1789181644.707784:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510121856 00000100:00100000:2.0:1789181644.707817:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789181644.707825:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c0659500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:15740:x1876092510121856:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789181644.708207:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c0659500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:15740:x1876092510121856:12345-0@lo:1000:mdt00_003.0 Request processed in 383us (1327us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1789181644.708226:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789181644.708649:0:15740:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc18392e9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789181644.708682:0:15740:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc19c36df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:15740:1876092510121856:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1789181644.708787:0:15740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e4284c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181644.708798:0:15740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e4284c lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181644.708822:0:15740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e4284c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181644.708828:0:15740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1bfa1fe00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:2.0:1789181644.708893:0:15740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e4284c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181644.708904:0:15740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e4284c lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181644.708918:0:15740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9dc192187c00) 00010000:00010000:2.0:1789181644.708921:0:15740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789181644.708926:0:15740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e4284c lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181644.708932:0:15740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1fe00/0x8f4f7840b2e4284c lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181644.708965:0:15740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890800/0x8f4f7840b2e427a4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181644.708972:0:15740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890800/0x8f4f7840b2e427a4 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181644.708977:0:15740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890800/0x8f4f7840b2e427a4 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181644.708983:0:15740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc189890800 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:2.0:1789181644.708986:0:15740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890800/0x8f4f7840b2e427a4 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181644.709002:0:15740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890800/0x8f4f7840b2e427a4 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181644.709011:0:15740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dc18553a600) 00010000:00010000:2.0:1789181644.709013:0:15740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789181644.709020:0:15740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab8c00/0x8f4f7840b2e427ab lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f557 expref: 17 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181644.709104:0:15740:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab8c00/0x8f4f7840b2e427ab lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f557 expref: 17 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181644.709115:0:15740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab8c00/0x8f4f7840b2e427ab lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f557 expref: 17 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181644.709168:0:15740:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab8c00/0x8f4f7840b2e427ab lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f557 expref: 17 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789181644.709180:0:15740:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b66de300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15740:1876092510121984:192.168.204.32@tcp:105: 00000100:00100000:2.0:1789181644.709296:0:15740:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dc1ba4b9a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789181644.713156:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181644.713237:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488120320 00000100:00100000:1.0:1789181644.713245:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488120320 00000100:00100000:1.0:1789181644.713310:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 12 00000100:00100000:1.0:1789181644.713462:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b66ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:049cbf1a-15b2-4d25-854c-0a3797b8f42e+18:14534:x1876092488120320:12345-192.168.204.32@tcp:49:bash.0 00000100:00100000:1.0:1789181644.713583:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b66ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:049cbf1a-15b2-4d25-854c-0a3797b8f42e+18:14534:x1876092488120320:12345-192.168.204.32@tcp:49:bash.0 Request processed in 254us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181644.713591:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 12 00000100:00100000:3.0:1789181644.716503:0:15740:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b66de300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15740:1876092510121984:192.168.204.32@tcp:105: 00010000:00010000:3.0:1789181644.716534:0:15740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890800/0x8f4f7840b2e427a4 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181644.716544:0:15740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890800/0x8f4f7840b2e427a4 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181644.716691:0:15740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785a00/0x8f4f7840b2e42853 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181644.716707:0:15740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785a00/0x8f4f7840b2e42853 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181644.716719:0:15740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785a00/0x8f4f7840b2e42853 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181644.716746:0:15740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785a00/0x8f4f7840b2e42853 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181644.716752:0:15740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785a00/0x8f4f7840b2e42853 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181644.716759:0:15740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785a00/0x8f4f7840b2e42853 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181644.716764:0:15740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1ba785a00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:2.0:1789181644.716768:0:15740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785a00/0x8f4f7840b2e42853 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181644.716776:0:15740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785a00/0x8f4f7840b2e42853 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181644.716787:0:15740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dc18553a600) 00010000:00010000:2.0:1789181644.716790:0:15740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789181644.716794:0:15740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785a00/0x8f4f7840b2e42853 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181644.716800:0:15740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1ba785a00/0x8f4f7840b2e42853 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181644.716811:0:15740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f800/0x8f4f7840b2e42845 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181644.716817:0:15740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f800/0x8f4f7840b2e42845 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181644.716823:0:15740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f800/0x8f4f7840b2e42845 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181644.716848:0:15740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1bfa1f800 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:2.0:1789181644.716851:0:15740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f800/0x8f4f7840b2e42845 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181644.716857:0:15740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f800/0x8f4f7840b2e42845 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181644.716865:0:15740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dc18553a600) 00010000:00010000:2.0:1789181644.716867:0:15740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789181644.716870:0:15740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f800/0x8f4f7840b2e42845 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789181644.716875:0:15740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1bfa1f800/0x8f4f7840b2e42845 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15740 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789181644.717461:0:14458:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789181644.717466:0:14458:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789181644.717492:0:14458:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1789181644.717498:0:14458:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1789181644.717962:0:15740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b66dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:049cbf1a-15b2-4d25-854c-0a3797b8f42e+17:14537:x1876092488120064:12345-192.168.204.32@tcp:57:lhsmtool_posix.0 Request processed in 22122us (22391us total) trans 8589934628 rc 0/0 00000100:00100000:2.0:1789181644.717973:0:15740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 60 00000020:00080000:2.0:1789181644.717979:0:15740:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1789181644.718246:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181644.720718:0:16649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488120448 00000100:00100000:1.0:1789181644.720733:0:16649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488120448 00000100:00100000:1.0:1789181644.720801:0:16649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 18 00000100:00100000:1.0:1789181644.720813:0:16649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c0268e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:049cbf1a-15b2-4d25-854c-0a3797b8f42e+7:14534:x1876092488120448:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:1.0:1789181644.720828:0:16649:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789181644.720994:0:16649:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000328f41ed/0x8f4f7840b2e4285a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f58f expref: -99 pid: 16649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789181644.721020:0:16649:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x6aa4becc, atime: 0x6aa4beca, ctime: 0x6aa4becc, blocks: 0x1 00010000:00010000:1.0:1789181644.721101:0:16649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=536s v=(0 0) 00010000:00010000:1.0:1789181644.721168:0:16649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789181644.721180:0:16649:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000328f41ed/0x8f4f7840b2e4285a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f58f expref: 8 pid: 16649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181644.721196:0:16649:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000328f41ed/0x8f4f7840b2e4285a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f58f expref: 8 pid: 16649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181644.721227:0:16649:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc1baab8200, rc 0) 00000100:00100000:1.0:1789181644.721296:0:16649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c0268e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:049cbf1a-15b2-4d25-854c-0a3797b8f42e+8:14534:x1876092488120448:12345-192.168.204.32@tcp:101:bash.0 Request processed in 486us (3051us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181644.721303:0:16649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 18 00000100:00100000:2.0:1789181644.723884:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181644.724069:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488120704 00000100:00100000:1.0:1789181644.724078:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488120704 00000100:00100000:1.0:1789181644.724138:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 13 00000100:00100000:1.0:1789181644.724148:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b66dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:049cbf1a-15b2-4d25-854c-0a3797b8f42e+17:14537:x1876092488120704:12345-192.168.204.32@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1789181644.725323:0:14426:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789181644.725639:0:14426:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00010000:00010000:1.0:1789181644.725899:0:14426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab9e00/0x8f4f7840b2e42861 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181644.725916:0:14426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab9e00/0x8f4f7840b2e42861 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181644.725928:0:14426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab9e00/0x8f4f7840b2e42861 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181644.725938:0:14426:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab9e00/0x8f4f7840b2e42861 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181644.725944:0:14426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab9e00/0x8f4f7840b2e42861 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181644.725951:0:14426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab9e00/0x8f4f7840b2e42861 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789181644.725984:0:14426:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789181644.726194:0:14412:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789181644.726201:0:14412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab9e00/0x8f4f7840b2e42861 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181644.726208:0:14412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc1baab9e00 already unused, calling callback (ffffffffc152f9b0) 00010000:00010000:3.0:1789181644.726212:0:14412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab9e00/0x8f4f7840b2e42861 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181644.726221:0:14412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab9e00/0x8f4f7840b2e42861 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181644.726233:0:14412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9dc192187c00) 00010000:00010000:3.0:1789181644.726236:0:14412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789181644.726242:0:14412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab9e00/0x8f4f7840b2e42861 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181644.726248:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc1baab9e00/0x8f4f7840b2e42861 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789181644.726271:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181644.726272:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789181644.726284:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789181644.726534:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b66dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:049cbf1a-15b2-4d25-854c-0a3797b8f42e+19:14537:x1876092488120704:12345-192.168.204.32@tcp:35:lhsmtool_posix.0 Request processed in 2384us (2655us total) trans 8589934630 rc 0/0 00000100:00100000:1.0:1789181644.726544:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 13 00000020:00080000:1.0:1789181644.726550:0:14426:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789181644.729013:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181644.731488:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488120960 00000100:00100000:3.0:1789181644.731504:0:14427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488120960 00000100:00100000:2.0:1789181644.731932:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 14 00000100:00100000:2.0:1789181644.731943:0:14427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c026b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:049cbf1a-15b2-4d25-854c-0a3797b8f42e+19:14534:x1876092488120960:12345-192.168.204.32@tcp:35:bash.0 00000001:00080000:2.0:1789181644.732512:0:14427:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934631 00000001:00080000:2.0:1789181644.732625:0:14427:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934632 00000100:00100000:2.0:1789181644.732912:0:14427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c026b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:049cbf1a-15b2-4d25-854c-0a3797b8f42e+22:14534:x1876092488120960:12345-192.168.204.32@tcp:35:bash.0 Request processed in 969us (3905us total) trans 8589934633 rc 0/0 00000100:00100000:2.0:1789181644.732922:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 14 00000020:00080000:2.0:1789181644.732927:0:14427:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1789181644.838263:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181644.838371:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488121216 00000100:00100000:0.0:1789181644.838381:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488121216 00000100:00100000:0.0:1789181644.838438:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 61 00000100:00100000:0.0:1789181644.838450:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b66df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:049cbf1a-15b2-4d25-854c-0a3797b8f42e+22:14547:x1876092488121216:12345-192.168.204.32@tcp:101:lfs.0 00010000:00010000:0.0:1789181644.838475:0:14423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789181644.838494:0:14423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891400/0x8f4f7840b2e42868 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x50421b3f3e91f596 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789181644.838574:0:14423:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1789181644.838691:0:14423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891400/0x8f4f7840b2e42868 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f596 expref: 24 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181644.838705:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dc18553ab00) 00010000:00010000:0.0:1789181644.838708:0:14423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789181644.838713:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189891400/0x8f4f7840b2e42868 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0x50421b3f3e91f596 expref: 24 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181644.838738:0:14423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dc189891400, rc 0) 00000100:00100000:0.0:1789181644.838798:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b66df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:049cbf1a-15b2-4d25-854c-0a3797b8f42e+23:14547:x1876092488121216:12345-192.168.204.32@tcp:101:lfs.0 Request processed in 351us (546us total) trans 8589934634 rc 301/301 00000100:00100000:0.0:1789181644.838806:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 61 00000100:00100000:3.0:1789181644.841540:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789181644.841678:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488121344 00000100:00100000:0.0:1789181644.841689:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488121344 00000100:00100000:0.0:1789181644.841760:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 62 00000100:00100000:0.0:1789181644.841771:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c065a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:049cbf1a-15b2-4d25-854c-0a3797b8f42e+23:14547:x1876092488121344:12345-192.168.204.32@tcp:34:lfs.0 00010000:00010000:0.0:1789181644.841866:0:14425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e42876 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181644.841882:0:14425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e42876 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181644.841896:0:14425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e42876 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181644.841911:0:14425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890c00/0x8f4f7840b2e4287d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181644.841918:0:14425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890c00/0x8f4f7840b2e4287d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181644.841924:0:14425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890c00/0x8f4f7840b2e4287d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181644.842240:0:14425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890a00/0x8f4f7840b2e42884 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181644.842261:0:14425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890a00/0x8f4f7840b2e42884 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181644.842269:0:14425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890a00/0x8f4f7840b2e42884 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789181644.842319:0:14425:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890a00/0x8f4f7840b2e42884 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181644.842355:0:14425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e42876 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181644.842362:0:14425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e42876 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181644.842369:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e42876 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181644.842375:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc189890000 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:0.0:1789181644.842379:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e42876 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181644.842386:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e42876 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181644.842397:0:14425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9dc19bc16200) 00010000:00010000:0.0:1789181644.842400:0:14425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789181644.842405:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e42876 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181644.842411:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890000/0x8f4f7840b2e42876 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181644.842428:0:14425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890c00/0x8f4f7840b2e4287d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181644.842435:0:14425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890c00/0x8f4f7840b2e4287d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181644.842440:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890c00/0x8f4f7840b2e4287d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181644.842446:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc189890c00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:0.0:1789181644.842449:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890c00/0x8f4f7840b2e4287d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181644.842455:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890c00/0x8f4f7840b2e4287d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181644.842463:0:14425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9dc18553a000) 00010000:00010000:0.0:1789181644.842465:0:14425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789181644.842468:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890c00/0x8f4f7840b2e4287d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181644.842474:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890c00/0x8f4f7840b2e4287d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181644.842493:0:14425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890a00/0x8f4f7840b2e42884 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181644.842500:0:14425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890a00/0x8f4f7840b2e42884 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181644.842506:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890a00/0x8f4f7840b2e42884 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181644.842517:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dc189890a00 already unused, calling callback (ffffffffc1f6c4f0) 00010000:00010000:0.0:1789181644.842521:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890a00/0x8f4f7840b2e42884 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181644.842527:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890a00/0x8f4f7840b2e42884 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181644.842536:0:14425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dc18553a600) 00010000:00010000:0.0:1789181644.842538:0:14425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789181644.842541:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890a00/0x8f4f7840b2e42884 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789181644.842547:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dc189890a00/0x8f4f7840b2e42884 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789181644.842625:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c065a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:049cbf1a-15b2-4d25-854c-0a3797b8f42e+23:14547:x1876092488121344:12345-192.168.204.32@tcp:34:lfs.0 Request processed in 856us (1100us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181644.842633:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 62 00000100:00100000:2.0:1789181644.845926:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181644.846011:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488121600 00000100:00100000:1.0:1789181644.846021:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488121600 00000100:00100000:1.0:1789181644.846074:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 15 00000100:00100000:1.0:1789181644.846085:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b66de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:049cbf1a-15b2-4d25-854c-0a3797b8f42e+23:14547:x1876092488121600:12345-192.168.204.32@tcp:35:lfs.0 00000100:00100000:1.0:1789181644.846358:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b66de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:049cbf1a-15b2-4d25-854c-0a3797b8f42e+24:14547:x1876092488121600:12345-192.168.204.32@tcp:35:lfs.0 Request processed in 247us (414us total) trans 8589934635 rc 0/0 00000100:00100000:1.0:1789181644.846366:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 15 00010000:00010000:3.0:1789181644.993291:0:16126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789181645.910706:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181645.910751:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181645.911001:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181645.911029:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181645.911047:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789181645.911064:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181645.911140:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488121728 00000100:00100000:1.0:1789181645.911150:0:14418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488121728 00000100:00100000:1.0:1789181645.911197:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 123 00000100:00100000:1.0:1789181645.911207:0:14418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c1ce0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e09b034e-9c19-4cf8-a37d-2da41b05039c+13:2354:x1876092488121728:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:1.0:1789181645.911281:0:14418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c1ce0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e09b034e-9c19-4cf8-a37d-2da41b05039c+13:2354:x1876092488121728:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 75us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181645.911288:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 123 00000100:00100000:1.0:1789181645.911447:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488122240 00000100:00100000:1.0:1789181645.911450:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488122240 00000100:00100000:3.0:1789181645.917281:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181645.923444:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488121856 00000100:00100000:1.0:1789181645.923476:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488121856 00000100:00100000:1.0:1789181645.923548:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 31 00000100:00100000:1.0:1789181645.923561:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c0659180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f95d2205-e877-434a-82a2-5130e9e350fc+6:2354:x1876092488122240:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:1.0:1789181645.923691:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c0659180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f95d2205-e877-434a-82a2-5130e9e350fc+6:2354:x1876092488122240:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 132us (12688us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181645.923699:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 31 00000100:00100000:1.0:1789181645.923719:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 32 00000100:00100000:1.0:1789181645.923726:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c065aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:049cbf1a-15b2-4d25-854c-0a3797b8f42e+24:2354:x1876092488121856:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:1.0:1789181645.923756:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c065aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:049cbf1a-15b2-4d25-854c-0a3797b8f42e+24:2354:x1876092488121856:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 30us (12707us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181645.923761:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 32 00000100:00080000:1.0:1789181645.923787:0:14419:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789181645.938908:0:16650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488121984 00000100:00100000:2.0:1789181645.938925:0:16650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488121984 00000100:00100000:2.0:1789181645.939117:0:16650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488122496 00000100:00100000:2.0:1789181645.939121:0:16650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488122496 00000100:00100000:2.0:1789181645.939147:0:16650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488122112 00000100:00100000:2.0:1789181645.939150:0:16650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488122112 00000100:00100000:2.0:1789181645.939164:0:16650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488122368 00000100:00100000:2.0:1789181645.939167:0:16650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488122368 00000100:00100000:2.0:1789181645.939189:0:16650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 18 00000100:00100000:2.0:1789181645.939199:0:16650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c0659f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:049cbf1a-15b2-4d25-854c-0a3797b8f42e+8:2354:x1876092488121984:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:2.0:1789181645.939284:0:16650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c0659f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:049cbf1a-15b2-4d25-854c-0a3797b8f42e+8:2354:x1876092488121984:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 86us (28532us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181645.939301:0:16650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 18 00000100:00100000:2.0:1789181645.939320:0:16650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 19 00000100:00100000:2.0:1789181645.939326:0:16650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c0658000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f95d2205-e877-434a-82a2-5130e9e350fc+5:2354:x1876092488122496:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:2.0:1789181645.939364:0:16650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c0658000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f95d2205-e877-434a-82a2-5130e9e350fc+5:2354:x1876092488122496:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 39us (28335us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181645.939370:0:16650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 19 00000100:00100000:2.0:1789181645.939380:0:16650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 20 00000100:00100000:2.0:1789181645.939385:0:16650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c065a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:049cbf1a-15b2-4d25-854c-0a3797b8f42e+5:2354:x1876092488122112:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:2.0:1789181645.939404:0:16650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c065a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:049cbf1a-15b2-4d25-854c-0a3797b8f42e+5:2354:x1876092488122112:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 18us (28339us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181645.939410:0:16650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 20 00000100:00100000:2.0:1789181645.939421:0:16650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 21 00000100:00100000:2.0:1789181645.939427:0:16650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c0658e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f95d2205-e877-434a-82a2-5130e9e350fc+5:2354:x1876092488122368:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:2.0:1789181645.939481:0:16650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c0658e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f95d2205-e877-434a-82a2-5130e9e350fc+5:2354:x1876092488122368:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 53us (22210us total) trans 0 rc 0/0 00000100:00100000:2.0:1789181645.939487:0:16650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 21 00000100:00080000:1.0:1789181645.941876:0:14419:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789181645.941887:0:14419:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789181646.016819:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789181646.974054:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934595 is committed 00000001:00080000:3.0:1789181646.974070:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00080000:3.0:1789181646.974076:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00000001:00080000:3.0:1789181646.974081:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934596 is committed 00010000:00010000:0.0:1789181647.038627:0:14412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789181647.135721:0:16690:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: /mnt/lustre/d1c.sanity-pcc/f1c.sanity-pcc expected pcc state: readwrite, but got: none 00000100:00100000:3.0:1789181647.461950:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789181647.468616:0:15112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488122624 00000100:00100000:1.0:1789181647.468631:0:15112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488122624 00002000:00100000:1.0:1789181647.468702:0:15112:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x22:0x0] (0->8) req@ffff9dc1c0658a80 x1876092488122624/t0(0) o4->049cbf1a-15b2-4d25-854c-0a3797b8f42e@192.168.204.32@tcp:23/0 lens 504/0 e 0 to 0 dl 1789181658 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1789181647.468714:0:15112:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9dc1c0658a80 with x1876092488122624 ext(0->8) 00002000:00010000:1.0:1789181647.468719:0:15112:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dc1c0658a80 00000100:00100000:1.0:1789181647.468746:0:15112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 0 00000100:00100000:1.0:1789181647.468757:0:15112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c0658a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:049cbf1a-15b2-4d25-854c-0a3797b8f42e+6:2351:x1876092488122624:12345-192.168.204.32@tcp:4:bash.0 00000100:00100000:1.0:1789181647.472700:0:15112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c0658a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:049cbf1a-15b2-4d25-854c-0a3797b8f42e+8:2351:x1876092488122624:12345-192.168.204.32@tcp:4:bash.0 Request processed in 3934us (10749us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1789181647.472714:0:15112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 0 00002000:00100000:1.0:1789181647.472730:0:15112:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x22:0x0] (0->8) req@ffff9dc1c0658a80 x1876092488122624/t8589934598(0) o4->049cbf1a-15b2-4d25-854c-0a3797b8f42e@192.168.204.32@tcp:23/0 lens 504/448 e 0 to 0 dl 1789181658 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1789181647.472740:0:15112:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9dc1c0658a80 with x1876092488122624 ext(0->8) 00002000:00010000:1.0:1789181647.472746:0:15112:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dc1c0658a80 00000100:00100000:2.0:1789181647.473507:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789181647.473626:0:16650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092488122752 00000100:00100000:2.0:1789181647.473634:0:16650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092488122752 00000100:00100000:2.0:1789181647.473677:0:16650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 19 00000100:00100000:2.0:1789181647.473686:0:16650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1b66dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:049cbf1a-15b2-4d25-854c-0a3797b8f42e+8:2351:x1876092488122752:12345-192.168.204.32@tcp:16:kworker.0 00000100:00080000:0.0:1789181647.474610:0:14419:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1789181647.509835:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00000100:00100000:0.0:1789181647.510141:0:16650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1b66dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:049cbf1a-15b2-4d25-854c-0a3797b8f42e+6:2351:x1876092488122752:12345-192.168.204.32@tcp:16:kworker.0 Request processed in 36450us (36631us total) trans 0 rc 0/0 00000100:00100000:0.0:1789181647.510153:0:16650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 19 00000100:00100000:3.0:1789181647.870538:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dc1b66dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510122112:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789181647.870621:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789181647.870768:0:15110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876092510122112 00000100:00100000:1.0:1789181647.870789:0:15110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876092510122112 00000100:00080000:0.0:1789181647.870842:0:14419:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789181647.870858:0:15110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789181647.870870:0:15110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9dc1c065ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510122112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789181647.870902:0:15110:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3856662528 00000100:00100000:1.0:1789181647.881663:0:15110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9dc1c065ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876092510122112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 10784us (11030us total) trans 0 rc 0/0 00000100:00100000:1.0:1789181647.881678:0:15110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789181647.889675:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:3.0:1789181647.889689:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9dc19c36c000, transno 8589934595 00000004:00080000:3.0:1789181647.889722:0:3305:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:3.0:1789181647.889788:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dc1b66dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876092510122112:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789181648.062759:0:16126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29762 lines, 29762 kept, 0 dropped, 0 bad.